[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:15 dist-test-slave-z8x9 krb5kdc[26518](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:15 dist-test-slave-z8x9 krb5kdc[26518](info): set up 2 sockets
Aug 11 11:05:15 dist-test-slave-z8x9 krb5kdc[26518](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 11:05:17.014979 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.462s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:17.142547 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:44771
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:44771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:17.229060 26539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:17.229329 26539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:17.229354 26539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:17.230552 26539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:17.230599 26539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:17.230613 26539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:17.230626 26539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:17.230677 26539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:17.232395 26539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:44771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:44771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:17.232758 26539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:17.233094 26539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:05:17.240338 26539 server_base.cc:1034] running on GCE node
W20260811 11:05:17.241411 26549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.241671 26555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.241673 26550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:17.242039 26539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:17.242504 26539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:17.243687 26539 hybrid_clock.cc:648] HybridClock initialized: now 1786446317243682 us; error 109 us; skew 500 ppm
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:17.246457 26539 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:17.247102 26539 webserver.cc:460] Webserver started at http://127.25.227.62:39755/ using document root <none> and password file <none>
I20260811 11:05:17.247442 26539 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:17.247527 26539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:17.247731 26539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:17.249219 26539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "120176b946bb44d7a3534fcc80f7087b"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "27d677642074f8cd30e13cd27e851fdc"
server_key_iv: "f413e284f02816cf3cf6e8f7a36caabd"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.249959 26539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "120176b946bb44d7a3534fcc80f7087b"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "27d677642074f8cd30e13cd27e851fdc"
server_key_iv: "f413e284f02816cf3cf6e8f7a36caabd"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.251961 26539 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 11:05:17.253019 26566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.253342 26539 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:17.253464 26539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "120176b946bb44d7a3534fcc80f7087b"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "27d677642074f8cd30e13cd27e851fdc"
server_key_iv: "f413e284f02816cf3cf6e8f7a36caabd"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.253580 26539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:17.264827 26539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:17.267086 26539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:17.267295 26539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:17.273057 26539 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:44771
I20260811 11:05:17.273136 26659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:44771 every 8 connection(s)
I20260811 11:05:17.273748 26539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:17.275127 26660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:17.278405 26660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b: Bootstrap starting.
I20260811 11:05:17.279063 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26539
I20260811 11:05:17.279183 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:17.279528 26660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:17.279870 26508 external_mini_cluster.cc:1428] Setting key 0dfc5d4e0a5ed2e71acb16f854af35f6
I20260811 11:05:17.279913 26660 log.cc:824] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:17.281011 26660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b: No bootstrap required, opened a new log
I20260811 11:05:17.283242 26660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120176b946bb44d7a3534fcc80f7087b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 44771 } }
I20260811 11:05:17.283478 26660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:17.283619 26660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 120176b946bb44d7a3534fcc80f7087b, State: Initialized, Role: FOLLOWER
I20260811 11:05:17.283869 26660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120176b946bb44d7a3534fcc80f7087b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 44771 } }
I20260811 11:05:17.284021 26660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:17.284070 26660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:17.284125 26660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:17.285077 26660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120176b946bb44d7a3534fcc80f7087b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 44771 } }
I20260811 11:05:17.285318 26660 leader_election.cc:302] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 120176b946bb44d7a3534fcc80f7087b; no voters:
I20260811 11:05:17.285584 26660 leader_election.cc:288] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:17.285609 26669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:17.285776 26669 raft_consensus.cc:686] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [term 1 LEADER]: Becoming Leader. State: Replica: 120176b946bb44d7a3534fcc80f7087b, State: Running, Role: LEADER
I20260811 11:05:17.286018 26669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120176b946bb44d7a3534fcc80f7087b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 44771 } }
I20260811 11:05:17.286139 26660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:17.286672 26670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "120176b946bb44d7a3534fcc80f7087b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120176b946bb44d7a3534fcc80f7087b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 44771 } } }
I20260811 11:05:17.286810 26670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:17.286676 26671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 120176b946bb44d7a3534fcc80f7087b. Latest consensus state: current_term: 1 leader_uuid: "120176b946bb44d7a3534fcc80f7087b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "120176b946bb44d7a3534fcc80f7087b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 44771 } } }
I20260811 11:05:17.286926 26671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:17.287026 26676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:17.288089 26676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:17.290680 26676 catalog_manager.cc:1347] Generated new cluster ID: 568289c8963b4a829b5a1b9c0706e27f
I20260811 11:05:17.290742 26676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:17.297609 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.281270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46426 (local address 127.25.227.62:44771)
0811 11:05:17.281549 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:17.281559 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:17.281797 (+ 238us) server_negotiation.cc:407] Connection header received
0811 11:05:17.283681 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:17.283686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:17.283797 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:17.283939 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:17.285759 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.287615 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.289135 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.289875 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.290044 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.293738 (+ 3694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:17.293742 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:17.293743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:17.293756 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:17.295567 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.296037 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.296046 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.296046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.296144 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.296424 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.296425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.296425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.296662 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:17.296833 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:17.297115 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 11:05:17.297328 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260811 11:05:17.313035 26676 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:17.313611 26676 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:17.323900 26676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 120176b946bb44d7a3534fcc80f7087b: Generated new TSK 0
I20260811 11:05:17.324118 26676 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:17.353794 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:44771
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:17.467931 26704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:17.468160 26704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:17.468195 26704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:17.469586 26704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:17.469643 26704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:17.469676 26704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:17.471406 26704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:44771
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:17.471731 26704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:17.471997 26704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:17.480146 26724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.480216 26714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.480319 26716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:17.480554 26704 server_base.cc:1034] running on GCE node
I20260811 11:05:17.480751 26704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:17.481004 26704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:17.482210 26704 hybrid_clock.cc:648] HybridClock initialized: now 1786446317482200 us; error 39 us; skew 500 ppm
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:17.485545 26704 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:17.486075 26704 webserver.cc:460] Webserver started at http://127.25.227.1:34745/ using document root <none> and password file <none>
I20260811 11:05:17.486274 26704 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:17.486315 26704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:17.486408 26704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:17.487633 26704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "df3ab22dbf744b65998132ad7777bd73"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "8939e9f3f50ff1c65ff57b0d680d8381"
server_key_iv: "c7697ab54060ecc2f82cdd2122c27d9e"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.488067 26704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "df3ab22dbf744b65998132ad7777bd73"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "8939e9f3f50ff1c65ff57b0d680d8381"
server_key_iv: "c7697ab54060ecc2f82cdd2122c27d9e"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.489959 26704 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 11:05:17.490774 26736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.490983 26704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:17.491062 26704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "df3ab22dbf744b65998132ad7777bd73"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "8939e9f3f50ff1c65ff57b0d680d8381"
server_key_iv: "c7697ab54060ecc2f82cdd2122c27d9e"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.491117 26704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:17.504902 26704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:17.507498 26704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:17.507655 26704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:17.508018 26704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:17.508361 26704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:17.508435 26704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.508460 26704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:17.508472 26704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.519936 26704 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:37835
I20260811 11:05:17.520072 26945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:37835 every 8 connection(s)
I20260811 11:05:17.520418 26704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:17.529740 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.521431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:45911 (local address 127.25.227.62:44771)
0811 11:05:17.521477 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:17.521479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:17.521687 (+ 208us) server_negotiation.cc:407] Connection header received
0811 11:05:17.522142 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:17.522143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:17.522158 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:17.522211 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:17.523255 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.523872 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.524864 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.525049 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.525099 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.527279 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:17.527280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:17.527281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:17.527287 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:17.528521 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.528879 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.528880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.528880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.528936 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.529145 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.529145 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.529145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.529311 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:17.529365 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:17.529604 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 11:05:17.529672 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:05:17.529889 26949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.521396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:44771 (local address 127.25.227.1:45911)
0811 11:05:17.521555 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:17.521592 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:17.522057 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:17.522262 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:17.522265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:17.522979 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:17.523173 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:17.523177 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.523953 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.523954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:17.524782 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:17.524785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.525118 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.525119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:17.525243 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.525781 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:17.525790 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:17.527193 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:17.528590 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:17.528597 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:17.528598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:17.528810 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:17.528993 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:17.528994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:17.528994 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:17.529092 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:17.529368 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:17.529373 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:17.529489 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 11:05:17.529575 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 11:05:17.529693 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260811 11:05:17.530537 26947 heartbeater.cc:347] Connected to a master server at 127.25.227.62:44771
I20260811 11:05:17.530615 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26704
I20260811 11:05:17.530654 26947 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:17.530695 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:17.530850 26508 external_mini_cluster.cc:1428] Setting key a313c3d9df25dbec75df51274227a9ab
I20260811 11:05:17.530877 26947 heartbeater.cc:511] Master 127.25.227.62:44771 requested a full tablet report, sending...
I20260811 11:05:17.531560 26596 ts_manager.cc:194] Registered new tserver with Master: df3ab22dbf744b65998132ad7777bd73 (127.25.227.1:37835)
I20260811 11:05:17.532565 26596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:45911
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:17.556339 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:44771
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:17.647245 26952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:17.647454 26952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:17.647478 26952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:17.648553 26952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:17.648589 26952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:17.648615 26952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:17.650110 26952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:44771
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:17.650310 26952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:17.650491 26952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:17.655823 26961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.655974 26959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.655857 26963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:17.656375 26952 server_base.cc:1034] running on GCE node
I20260811 11:05:17.656584 26952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:17.656836 26952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:17.657998 26952 hybrid_clock.cc:648] HybridClock initialized: now 1786446317657977 us; error 36 us; skew 500 ppm
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:17.660570 26952 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:17.661098 26952 webserver.cc:460] Webserver started at http://127.25.227.2:40293/ using document root <none> and password file <none>
I20260811 11:05:17.661376 26952 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:17.661444 26952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:17.661602 26952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:17.662684 26952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "064d6a54ae814ea98c55492677fa087b"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "5028cca2f754b6bf155a36f76cf8192d"
server_key_iv: "ff457d068062931fc47fef473819991e"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.663057 26952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "064d6a54ae814ea98c55492677fa087b"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "5028cca2f754b6bf155a36f76cf8192d"
server_key_iv: "ff457d068062931fc47fef473819991e"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.664642 26952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:17.665504 26978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.665683 26952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:17.665781 26952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "064d6a54ae814ea98c55492677fa087b"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "5028cca2f754b6bf155a36f76cf8192d"
server_key_iv: "ff457d068062931fc47fef473819991e"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.665889 26952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:17.693567 26952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:17.696305 26952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:17.696478 26952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:17.696775 26952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:17.697160 26952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:17.697245 26952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.697283 26952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:17.697325 26952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.707440 26952 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:41899
I20260811 11:05:17.707484 27176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:41899 every 8 connection(s)
I20260811 11:05:17.707821 26952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:17.712385 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26952
I20260811 11:05:17.712463 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:17.712651 26508 external_mini_cluster.cc:1428] Setting key 7a02e688dd7e9c953f701cdd46d23307
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:17.718289 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.708797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:41551 (local address 127.25.227.62:44771)
0811 11:05:17.708891 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:17.708893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:17.709078 (+ 185us) server_negotiation.cc:407] Connection header received
0811 11:05:17.709688 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:17.709689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:17.709702 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:17.709758 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:17.710744 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.711246 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.712236 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.712465 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.712532 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.714965 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:17.714967 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:17.714967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:17.714975 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:17.716660 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.717250 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.717252 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.717252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.717333 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.717640 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.717641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.717641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.717747 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:17.717801 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:17.718135 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 11:05:17.718210 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:05:17.718604 27179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.708753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:44771 (local address 127.25.227.2:41551)
0811 11:05:17.708941 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:17.708993 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:17.709576 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:17.709832 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:17.709836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:17.710438 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:17.710633 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:17.710638 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.711351 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.711353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:17.712144 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:17.712147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.712598 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.712599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:17.712755 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.713428 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:17.713439 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:17.714869 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:17.716728 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:17.716734 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:17.716736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:17.717098 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:17.717409 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:17.717410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:17.717411 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:17.717565 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:17.717812 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:17.717817 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:17.717992 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 11:05:17.718097 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:05:17.718304 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260811 11:05:17.719206 27177 heartbeater.cc:347] Connected to a master server at 127.25.227.62:44771
I20260811 11:05:17.719317 27177 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:17.719532 27177 heartbeater.cc:511] Master 127.25.227.62:44771 requested a full tablet report, sending...
I20260811 11:05:17.719964 26596 ts_manager.cc:194] Registered new tserver with Master: 064d6a54ae814ea98c55492677fa087b (127.25.227.2:41899)
I20260811 11:05:17.720350 26596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:41551
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:17.742337 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:44771
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:17.838582 27182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:17.838828 27182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:17.838872 27182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:17.840037 27182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:17.840106 27182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:17.840152 27182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:17.841728 27182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:44771
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:17.842011 27182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:17.842247 27182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:17.847774 27195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.847786 27190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:17.847860 27191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:17.847785 27182 server_base.cc:1034] running on GCE node
I20260811 11:05:17.848168 27182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:17.848413 27182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:17.849555 27182 hybrid_clock.cc:648] HybridClock initialized: now 1786446317849540 us; error 29 us; skew 500 ppm
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:17.852267 27182 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:17.852752 27182 webserver.cc:460] Webserver started at http://127.25.227.3:38009/ using document root <none> and password file <none>
I20260811 11:05:17.853065 27182 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:17.853135 27182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:17.853304 27182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:17.854462 27182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "63e2be16c19840459974d84a14495732"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "a1557cff987117f19ad12fca4ac7e98e"
server_key_iv: "fb075b2159c59f82ad4aef030b9f36f4"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.854902 27182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "63e2be16c19840459974d84a14495732"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "a1557cff987117f19ad12fca4ac7e98e"
server_key_iv: "fb075b2159c59f82ad4aef030b9f36f4"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.856472 27182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:17.857348 27207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.857587 27182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:17.857698 27182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "63e2be16c19840459974d84a14495732"
format_stamp: "Formatted at 2026-08-11 11:05:17 on dist-test-slave-z8x9"
server_key: "a1557cff987117f19ad12fca4ac7e98e"
server_key_iv: "fb075b2159c59f82ad4aef030b9f36f4"
server_key_version: "encryptionkey@0"
I20260811 11:05:17.857808 27182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:17.894409 27182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:17.896593 27182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:17.896791 27182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:17.897063 27182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:17.897460 27182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:17.897521 27182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.897569 27182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:17.897594 27182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:17.909965 27182 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:41965
I20260811 11:05:17.910049 27406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:41965 every 8 connection(s)
I20260811 11:05:17.910415 27182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:17.920331 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.911373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:50149 (local address 127.25.227.62:44771)
0811 11:05:17.911470 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:17.911472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:17.911718 (+ 246us) server_negotiation.cc:407] Connection header received
0811 11:05:17.912315 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:17.912316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:17.912330 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:17.912379 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:17.913503 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.914013 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.915018 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.915227 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.915312 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.917610 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:17.917612 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:17.917612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:17.917620 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:17.918918 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.919352 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.919353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.919353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.919418 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.919666 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.919667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.919668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.919793 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:17.919868 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:17.920151 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 11:05:17.920237 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:05:17.920513 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.911323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:44771 (local address 127.25.227.3:50149)
0811 11:05:17.911578 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:17.911617 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:17.912190 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:17.912466 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:17.912470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:17.913097 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:17.913400 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:17.913406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.914113 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.914115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:17.914911 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:17.914913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.915319 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.915321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:17.915456 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.915962 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:17.915971 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:17.917509 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:17.919018 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:17.919026 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:17.919028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:17.919263 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:17.919487 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:17.919488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:17.919488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:17.919595 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:17.919869 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:17.919877 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:17.920011 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 11:05:17.920114 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 11:05:17.920280 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":96,"threads_started":1}
I20260811 11:05:17.920606 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27182
I20260811 11:05:17.920710 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:17.920876 26508 external_mini_cluster.cc:1428] Setting key 8b7f56d5b25b3ddbb0fb05e060edc3a4
I20260811 11:05:17.921343 27408 heartbeater.cc:347] Connected to a master server at 127.25.227.62:44771
I20260811 11:05:17.921450 27408 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:17.921650 27408 heartbeater.cc:511] Master 127.25.227.62:44771 requested a full tablet report, sending...
I20260811 11:05:17.922173 26596 ts_manager.cc:194] Registered new tserver with Master: 63e2be16c19840459974d84a14495732 (127.25.227.3:41965)
I20260811 11:05:17.922562 26596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:50149
I20260811 11:05:17.933265 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:17.963531 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.955162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41014 (local address 127.25.227.1:37835)
0811 11:05:17.955395 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:17.955400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:17.955416 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:05:17.955502 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:17.955510 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:17.955533 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:17.955634 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:17.956243 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.957058 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.957836 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.958181 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.958275 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.960740 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:17.960750 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:17.960750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:17.960766 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:17.962486 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.962815 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.962818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.962818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.962878 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.963051 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.963051 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.963051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.963190 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:17.963325 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:17.963381 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 11:05:17.963448 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":117,"threads_started":1}
W20260811 11:05:17.964044 26783 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41014
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:05:17 dist-test-slave-z8x9 krb5kdc[26518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:17.991277 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:17.984025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41018 (local address 127.25.227.1:37835)
0811 11:05:17.984097 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:17.984099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:17.984168 (+ 69us) server_negotiation.cc:407] Connection header received
0811 11:05:17.984223 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:17.984224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:17.984238 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:17.984290 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:17.984850 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.985409 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.986209 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:17.986409 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:17.986463 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:17.988892 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:17.988894 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:17.988894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:17.988901 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:17.990238 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.990556 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.990557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.990558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.990612 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:17.990846 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:17.990847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:17.990847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:17.990945 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:17.991033 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:17.991115 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 11:05:17.991179 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 11:05:17.991855 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26704
I20260811 11:05:18.008466 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26952
I20260811 11:05:18.018823 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27182
I20260811 11:05:18.043200 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26539
2026-08-11T11:05:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2526 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:18 dist-test-slave-z8x9 krb5kdc[27432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:18 dist-test-slave-z8x9 krb5kdc[27432](info): set up 2 sockets
Aug 11 11:05:18 dist-test-slave-z8x9 krb5kdc[27432](info): commencing operation
krb5kdc: starting...
W20260811 11:05:19.340621 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:19.466066 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36979
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:36979
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:19.549607 27461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:19.549834 27461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:19.549857 27461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:19.550980 27461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:19.551016 27461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:19.551030 27461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:19.551043 27461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:19.551057 27461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:19.552556 27461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:36979
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:19.552778 27461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:19.552974 27461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:19.558112 27470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:19.558122 27474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:19.558145 27468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:19.558494 27461 server_base.cc:1034] running on GCE node
I20260811 11:05:19.558789 27461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:19.559103 27461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:19.560297 27461 hybrid_clock.cc:648] HybridClock initialized: now 1786446319560282 us; error 30 us; skew 500 ppm
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:19.563002 27461 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:19.563584 27461 webserver.cc:460] Webserver started at http://127.25.227.62:33355/ using document root <none> and password file <none>
I20260811 11:05:19.563861 27461 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:19.563936 27461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:19.564095 27461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:19.565271 27461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "1b5a1b8ac6a48de2f8997780c7aeaebd"
server_key_iv: "7338d88d8cf2ac7683793e7c1ae474b2"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.565652 27461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "1b5a1b8ac6a48de2f8997780c7aeaebd"
server_key_iv: "7338d88d8cf2ac7683793e7c1ae474b2"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.567155 27461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:05:19.567910 27484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.568091 27461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:19.568202 27461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "1b5a1b8ac6a48de2f8997780c7aeaebd"
server_key_iv: "7338d88d8cf2ac7683793e7c1ae474b2"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.568285 27461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:19.582521 27461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:19.584499 27461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:19.584676 27461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:19.588764 27461 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:36979
I20260811 11:05:19.588805 27563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:36979 every 8 connection(s)
I20260811 11:05:19.589249 27461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:19.590281 27564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:19.591077 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27461
I20260811 11:05:19.591176 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:19.591332 26508 external_mini_cluster.cc:1428] Setting key 317031a0ec8ea7c8d2b35daaed848497
I20260811 11:05:19.593668 27564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f: Bootstrap starting.
I20260811 11:05:19.594412 27564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:19.594754 27564 log.cc:824] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:19.595472 27564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f: No bootstrap required, opened a new log
I20260811 11:05:19.597703 27564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36979 } }
I20260811 11:05:19.597841 27564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:19.597865 27564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ff618bf2f44ce8bdb42025e2bf0d1f, State: Initialized, Role: FOLLOWER
I20260811 11:05:19.598001 27564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36979 } }
I20260811 11:05:19.598079 27564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:19.598104 27564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:19.598166 27564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 0 FOLLOWER]: Advancing to term 1
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:19.598830 27564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36979 } }
I20260811 11:05:19.598919 27564 leader_election.cc:302] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91ff618bf2f44ce8bdb42025e2bf0d1f; no voters:
I20260811 11:05:19.599144 27564 leader_election.cc:288] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:19.599215 27569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:19.599416 27569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [term 1 LEADER]: Becoming Leader. State: Replica: 91ff618bf2f44ce8bdb42025e2bf0d1f, State: Running, Role: LEADER
I20260811 11:05:19.599478 27564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:19.599540 27569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36979 } }
I20260811 11:05:19.599865 27569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91ff618bf2f44ce8bdb42025e2bf0d1f. Latest consensus state: current_term: 1 leader_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36979 } } }
I20260811 11:05:19.599956 27569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:19.600164 27570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ff618bf2f44ce8bdb42025e2bf0d1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36979 } } }
I20260811 11:05:19.600172 27577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:19.600389 27570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:19.601341 27577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:19.603948 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:19.591909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41916 (local address 127.25.227.62:36979)
0811 11:05:19.592135 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:19.592145 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:19.592179 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:05:19.592749 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:19.592759 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:19.592828 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:19.592986 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:19.593633 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.595039 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.595891 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.596331 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.596462 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:19.599088 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:19.599093 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:19.599093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:19.599105 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:19.602103 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:19.602571 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:19.602574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:19.602575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:19.602680 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:19.602885 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:19.602886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:19.602887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:19.603199 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:19.603359 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:19.603572 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 11:05:19.603723 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260811 11:05:19.605566 27577 catalog_manager.cc:1347] Generated new cluster ID: a2ff31f3b19940be9f66e61278cecca4
I20260811 11:05:19.605641 27577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:19.637748 27577 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:19.638365 27577 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:19.641460 27577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91ff618bf2f44ce8bdb42025e2bf0d1f: Generated new TSK 0
I20260811 11:05:19.641657 27577 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:19.676208 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36979
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:19.760257 27604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:19.760473 27604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:19.760496 27604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:19.761745 27604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:19.761788 27604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:19.761838 27604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:19.763356 27604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36979
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:19.763602 27604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:19.763844 27604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:19.768874 27615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:19.768913 27613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:19.768913 27612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:19.769007 27604 server_base.cc:1034] running on GCE node
I20260811 11:05:19.769456 27604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:19.769731 27604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:19.770902 27604 hybrid_clock.cc:648] HybridClock initialized: now 1786446319770887 us; error 49 us; skew 500 ppm
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:19.773804 27604 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:19.774236 27604 webserver.cc:460] Webserver started at http://127.25.227.1:40937/ using document root <none> and password file <none>
I20260811 11:05:19.774468 27604 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:19.774538 27604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:19.774701 27604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:19.775822 27604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "09624473879445a8b7e32c1d733a7f5b"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "c7aad6d2c8d02b4761c1466f2455ec2a"
server_key_iv: "ecfeb753ba61cb7434387b86bd66fd6a"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.776199 27604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "09624473879445a8b7e32c1d733a7f5b"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "c7aad6d2c8d02b4761c1466f2455ec2a"
server_key_iv: "ecfeb753ba61cb7434387b86bd66fd6a"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.777667 27604 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:19.778427 27627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.778601 27604 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:19.778705 27604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "09624473879445a8b7e32c1d733a7f5b"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "c7aad6d2c8d02b4761c1466f2455ec2a"
server_key_iv: "ecfeb753ba61cb7434387b86bd66fd6a"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.778801 27604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:19.791191 27604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:19.793242 27604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:19.793414 27604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:19.793669 27604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:19.794000 27604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:19.794056 27604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.794093 27604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:19.794137 27604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.800529 27604 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:35569
I20260811 11:05:19.800590 27819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:35569 every 8 connection(s)
I20260811 11:05:19.800945 27604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:19.801661 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27604
I20260811 11:05:19.801774 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:19.801949 26508 external_mini_cluster.cc:1428] Setting key ed80fcf8e2fa016d4beb6c450e7fc600
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
I20260811 11:05:19.811797 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:19.802102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:44519 (local address 127.25.227.62:36979)
0811 11:05:19.802148 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:19.802151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:19.802162 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:05:19.803364 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:19.803366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:19.803378 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:19.803435 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:19.804131 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.804936 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.806036 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.806366 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.806455 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:19.808780 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:19.808782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:19.808783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:19.808791 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:19.810309 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:19.810775 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:19.810776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:19.810776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:19.810839 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:19.811110 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:19.811111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:19.811111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:19.811231 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:19.811310 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:19.811597 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 11:05:19.811692 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:19.812031 27825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:19.801832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36979 (local address 127.25.227.1:44519)
0811 11:05:19.802012 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:19.802057 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:19.803240 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:19.803512 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:19.803515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:19.803817 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:19.804014 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:19.804018 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.805054 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.805055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:19.805949 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:19.805952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.806492 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.806494 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:19.806628 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:19.807200 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:19.807208 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:19.808676 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:19.810419 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:19.810428 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:19.810430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:19.810675 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:19.810911 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:19.810911 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:19.810912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:19.811032 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:19.811302 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:19.811310 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:19.811459 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 11:05:19.811574 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 11:05:19.811740 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":102,"threads_started":1}
I20260811 11:05:19.812585 27822 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36979
I20260811 11:05:19.812707 27822 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:19.812901 27822 heartbeater.cc:511] Master 127.25.227.62:36979 requested a full tablet report, sending...
I20260811 11:05:19.813498 27508 ts_manager.cc:194] Registered new tserver with Master: 09624473879445a8b7e32c1d733a7f5b (127.25.227.1:35569)
I20260811 11:05:19.814136 27508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:44519
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:19.829670 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36979
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:19.915654 27830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:19.915890 27830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:19.915933 27830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:19.917083 27830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:19.917153 27830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:19.917220 27830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:19.918725 27830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36979
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:19.919008 27830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:19.919241 27830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:19.924324 27839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:19.924336 27836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:19.924553 27830 server_base.cc:1034] running on GCE node
W20260811 11:05:19.924384 27841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:19.924811 27830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:19.925071 27830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:19.926263 27830 hybrid_clock.cc:648] HybridClock initialized: now 1786446319926248 us; error 46 us; skew 500 ppm
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:19.934731 27830 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:19.935334 27830 webserver.cc:460] Webserver started at http://127.25.227.2:36341/ using document root <none> and password file <none>
I20260811 11:05:19.935578 27830 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:19.935648 27830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:19.935806 27830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:19.936887 27830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "de56db5f4aa14da3bb3b8fa7f01548a8"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "009b0abe55309d6c5591c607a57bcfa3"
server_key_iv: "86130237526b9d68360081d9994e1482"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.937335 27830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "de56db5f4aa14da3bb3b8fa7f01548a8"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "009b0abe55309d6c5591c607a57bcfa3"
server_key_iv: "86130237526b9d68360081d9994e1482"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.938804 27830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:19.939577 27853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.939817 27830 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:19.939926 27830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "de56db5f4aa14da3bb3b8fa7f01548a8"
format_stamp: "Formatted at 2026-08-11 11:05:19 on dist-test-slave-z8x9"
server_key: "009b0abe55309d6c5591c607a57bcfa3"
server_key_iv: "86130237526b9d68360081d9994e1482"
server_key_version: "encryptionkey@0"
I20260811 11:05:19.940037 27830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:19.955883 27830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:19.958070 27830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:19.958269 27830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:19.958540 27830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:19.958884 27830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:19.958941 27830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.958983 27830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:19.959013 27830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:19.965451 27830 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:35051
I20260811 11:05:19.965525 28049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:35051 every 8 connection(s)
I20260811 11:05:19.965857 27830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
Aug 11 11:05:19 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:19.975190 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27830
I20260811 11:05:19.975276 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:19.975457 26508 external_mini_cluster.cc:1428] Setting key 2ab120947f1ab7467fbbec2d8f51e589
I20260811 11:05:19.975687 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:19.966663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:41115 (local address 127.25.227.62:36979)
0811 11:05:19.966733 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:19.966735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:19.966951 (+ 216us) server_negotiation.cc:407] Connection header received
0811 11:05:19.967890 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:19.967892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:19.967904 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:19.967968 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:19.968604 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.969106 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.970137 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.970323 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.970379 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:19.972652 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:19.972654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:19.972655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:19.972670 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:19.974152 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:19.974612 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:19.974614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:19.974614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:19.974679 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:19.974947 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:19.974948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:19.974949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:19.975069 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:19.975147 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:19.975502 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 11:05:19.975585 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:19.975898 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:19.966621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36979 (local address 127.25.227.2:41115)
0811 11:05:19.966806 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:19.966850 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:19.967788 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:19.968023 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:19.968027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:19.968301 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:19.968496 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:19.968500 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.969239 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.969240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:19.970061 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:19.970064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:19.970400 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:19.970401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:19.970500 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:19.971035 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:19.971044 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:19.972541 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:19.974266 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:19.974274 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:19.974277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:19.974522 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:19.974748 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:19.974749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:19.974749 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:19.974869 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:19.975139 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:19.975146 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:19.975339 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 11:05:19.975469 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 11:05:19.975641 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260811 11:05:19.976572 28056 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36979
I20260811 11:05:19.976677 28056 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:19.976883 28056 heartbeater.cc:511] Master 127.25.227.62:36979 requested a full tablet report, sending...
I20260811 11:05:19.977339 27508 ts_manager.cc:194] Registered new tserver with Master: de56db5f4aa14da3bb3b8fa7f01548a8 (127.25.227.2:35051)
I20260811 11:05:19.977723 27508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:41115
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:20.004530 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36979
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:20.088450 28064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:20.088652 28064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:20.088676 28064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:20.089879 28064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:20.089926 28064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:20.089953 28064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:20.091498 28064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36979
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:20.091758 28064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:20.092023 28064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:20.097222 28073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:20.097261 28074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:20.097229 28076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:20.097421 28064 server_base.cc:1034] running on GCE node
I20260811 11:05:20.097662 28064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:20.097965 28064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:20.099148 28064 hybrid_clock.cc:648] HybridClock initialized: now 1786446320099131 us; error 28 us; skew 500 ppm
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446320, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:20.102299 28064 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:20.102777 28064 webserver.cc:460] Webserver started at http://127.25.227.3:41715/ using document root <none> and password file <none>
I20260811 11:05:20.103034 28064 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:20.103104 28064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:20.103258 28064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:20.104333 28064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "cdcdf26a496343ffb2bf5bef6ab6b679"
format_stamp: "Formatted at 2026-08-11 11:05:20 on dist-test-slave-z8x9"
server_key: "7ba560ccbfefa5bf79346b86586057c8"
server_key_iv: "de7c27e7b5b763d97e3dd979c3fd6a3a"
server_key_version: "encryptionkey@0"
I20260811 11:05:20.104707 28064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "cdcdf26a496343ffb2bf5bef6ab6b679"
format_stamp: "Formatted at 2026-08-11 11:05:20 on dist-test-slave-z8x9"
server_key: "7ba560ccbfefa5bf79346b86586057c8"
server_key_iv: "de7c27e7b5b763d97e3dd979c3fd6a3a"
server_key_version: "encryptionkey@0"
I20260811 11:05:20.106153 28064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:20.106954 28087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:20.107182 28064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:20.107285 28064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "cdcdf26a496343ffb2bf5bef6ab6b679"
format_stamp: "Formatted at 2026-08-11 11:05:20 on dist-test-slave-z8x9"
server_key: "7ba560ccbfefa5bf79346b86586057c8"
server_key_iv: "de7c27e7b5b763d97e3dd979c3fd6a3a"
server_key_version: "encryptionkey@0"
I20260811 11:05:20.107368 28064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:20.117305 28064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:20.119611 28064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:20.119781 28064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:20.120007 28064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:20.120314 28064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:20.120369 28064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:20.120411 28064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:20.120440 28064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:20.127687 28064 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:46589
I20260811 11:05:20.127733 28295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:46589 every 8 connection(s)
I20260811 11:05:20.128063 28064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:20.130430 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28064
I20260811 11:05:20.130540 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:20.130693 26508 external_mini_cluster.cc:1428] Setting key 518f4ae695c58f95531e41ac724a7de2
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446320, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:20.137784 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.128946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:40051 (local address 127.25.227.62:36979)
0811 11:05:20.128992 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.128994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.129220 (+ 226us) server_negotiation.cc:407] Connection header received
0811 11:05:20.130301 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.130302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.130313 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.130364 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:20.131171 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.131813 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.132789 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.132970 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.133016 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.135114 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:20.135115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:20.135116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:20.135122 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:20.136471 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.136853 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.136853 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.136854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.136908 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.137132 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.137133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.137133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.137304 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:20.137373 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.137647 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.137711 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 11:05:20.138024 28301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.128902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36979 (local address 127.25.227.3:40051)
0811 11:05:20.129080 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:20.129123 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:20.130150 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:20.130441 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:20.130446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:20.130852 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:20.131062 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.131068 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.131892 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.131893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.132706 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.132708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.133038 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.133039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.133139 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.133650 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:20.133658 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:20.135027 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:20.136547 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:20.136553 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:20.136555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:20.136787 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:20.136967 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:20.136968 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:20.136968 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:20.137070 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:20.137375 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:20.137382 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:20.137515 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 11:05:20.137619 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 11:05:20.137751 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260811 11:05:20.138540 28296 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36979
I20260811 11:05:20.138650 28296 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:20.138862 28296 heartbeater.cc:511] Master 127.25.227.62:36979 requested a full tablet report, sending...
I20260811 11:05:20.139276 27508 ts_manager.cc:194] Registered new tserver with Master: cdcdf26a496343ffb2bf5bef6ab6b679 (127.25.227.3:46589)
I20260811 11:05:20.139618 27508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:40051
I20260811 11:05:20.142519 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:05:20.149803 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.144309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41918 (local address 127.25.227.62:36979)
0811 11:05:20.144370 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.144372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.144509 (+ 137us) server_negotiation.cc:407] Connection header received
0811 11:05:20.144544 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.144545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.144553 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.144599 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:20.145122 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.145648 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.146313 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.146483 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.146531 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.147611 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:20.147612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:20.147612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:20.147618 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:20.148779 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.149086 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.149087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.149087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.149138 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.149355 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.149356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.149356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.149496 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:20.149575 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.149661 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.149719 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:05:20.152112 27508 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:20.153970 27508 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:20.161557 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.156877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:46589 (local address 127.0.0.1:48298)
0811 11:05:20.157511 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:20.157521 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:20.157698 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:20.157977 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:20.157978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:20.157979 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:20.158018 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.158019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.158882 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.158883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.160157 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.160159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.161216 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.161217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.161315 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.161327 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 11:05:20.161403 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:05:20.161470 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":38,"thread_start_us":95,"threads_started":1}
I20260811 11:05:20.161566 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.157116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48298 (local address 127.25.227.3:46589)
0811 11:05:20.157347 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.157351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.157769 (+ 418us) server_negotiation.cc:407] Connection header received
0811 11:05:20.157813 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.157815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.157830 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.157901 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:20.158094 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.158774 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.160245 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.161035 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.161094 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.161151 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.161432 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.161478 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":114,"threads_started":1}
I20260811 11:05:20.161651 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.157155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56752 (local address 127.25.227.2:35051)
0811 11:05:20.157419 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.157424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.157436 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:05:20.157483 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.157485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.157503 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.157624 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:20.157917 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.159065 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.160336 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.161014 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.161092 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.161151 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.161520 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.161563 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":140,"threads_started":1}
I20260811 11:05:20.161995 28316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.156870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35051 (local address 127.0.0.1:56752)
0811 11:05:20.157268 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:20.157310 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:20.157402 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:20.157747 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:20.157751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:20.157753 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:20.157823 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.157826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.159177 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.159178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.160256 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.160258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.161213 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.161214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.161312 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.161327 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 11:05:20.161399 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 11:05:20.161471 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260811 11:05:20.162696 28312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.156862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:35569 (local address 127.0.0.1:36612)
0811 11:05:20.157037 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:20.157319 (+ 282us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:20.157418 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:20.157835 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:20.157836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:20.157838 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:20.157911 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.157913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.160336 (+ 2423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.160336 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.161034 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.161037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.162521 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.162522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.162572 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.162575 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:20.162621 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 11:05:20.162651 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":66,"threads_started":1}
I20260811 11:05:20.162662 28180 tablet_service.cc:1467] Processing CreateTablet for tablet db96c04573304cd397a4921ef6931834 (DEFAULT_TABLE table=test-table [id=58dfcd280c8f4a8d8f304b7dfbb1c645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:20.162923 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.156980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36612 (local address 127.25.227.1:35569)
0811 11:05:20.157266 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.157272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.157383 (+ 111us) server_negotiation.cc:407] Connection header received
0811 11:05:20.157523 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.157526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.157544 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.157708 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:20.158004 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.159065 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.161187 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.162434 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.162514 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.162573 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.162634 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.162680 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":99,"threads_started":1}
I20260811 11:05:20.163089 28180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db96c04573304cd397a4921ef6931834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:20.163556 27715 tablet_service.cc:1467] Processing CreateTablet for tablet db96c04573304cd397a4921ef6931834 (DEFAULT_TABLE table=test-table [id=58dfcd280c8f4a8d8f304b7dfbb1c645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:20.163892 27715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db96c04573304cd397a4921ef6931834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:20.166461 27935 tablet_service.cc:1467] Processing CreateTablet for tablet db96c04573304cd397a4921ef6931834 (DEFAULT_TABLE table=test-table [id=58dfcd280c8f4a8d8f304b7dfbb1c645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:20.166682 28320 tablet_bootstrap.cc:492] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: Bootstrap starting.
I20260811 11:05:20.166834 27935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db96c04573304cd397a4921ef6931834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:20.167282 28321 tablet_bootstrap.cc:492] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: Bootstrap starting.
I20260811 11:05:20.167604 28320 tablet_bootstrap.cc:654] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:20.168267 28321 tablet_bootstrap.cc:654] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:20.168520 28320 log.cc:824] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:20.169039 28321 log.cc:824] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:20.169548 28320 tablet_bootstrap.cc:492] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: No bootstrap required, opened a new log
I20260811 11:05:20.169639 28320 ts_tablet_manager.cc:1397] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:05:20.170104 28321 tablet_bootstrap.cc:492] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: No bootstrap required, opened a new log
I20260811 11:05:20.170246 28327 tablet_bootstrap.cc:492] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: Bootstrap starting.
I20260811 11:05:20.170276 28321 ts_tablet_manager.cc:1397] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:05:20.171020 28327 tablet_bootstrap.cc:654] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:20.171666 28327 log.cc:824] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:20.172632 28320 raft_consensus.cc:348] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.172817 28327 tablet_bootstrap.cc:492] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: No bootstrap required, opened a new log
I20260811 11:05:20.172848 28320 raft_consensus.cc:374] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:20.172884 28327 ts_tablet_manager.cc:1397] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:05:20.172896 28320 raft_consensus.cc:729] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdcdf26a496343ffb2bf5bef6ab6b679, State: Initialized, Role: FOLLOWER
I20260811 11:05:20.173038 28320 consensus_queue.cc:260] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.173080 28321 raft_consensus.cc:348] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.173316 28321 raft_consensus.cc:374] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:20.173374 28321 raft_consensus.cc:729] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09624473879445a8b7e32c1d733a7f5b, State: Initialized, Role: FOLLOWER
I20260811 11:05:20.173540 28321 consensus_queue.cc:260] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.173599 28320 ts_tablet_manager.cc:1428] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 11:05:20.173668 28296 heartbeater.cc:503] Master 127.25.227.62:36979 was elected leader, sending a full tablet report...
I20260811 11:05:20.174283 27822 heartbeater.cc:503] Master 127.25.227.62:36979 was elected leader, sending a full tablet report...
I20260811 11:05:20.174289 28321 ts_tablet_manager.cc:1428] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 11:05:20.175630 28327 raft_consensus.cc:348] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.175818 28327 raft_consensus.cc:374] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:20.175869 28327 raft_consensus.cc:729] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de56db5f4aa14da3bb3b8fa7f01548a8, State: Initialized, Role: FOLLOWER
I20260811 11:05:20.175984 28327 consensus_queue.cc:260] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.176265 28327 ts_tablet_manager.cc:1428] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:05:20.176329 28056 heartbeater.cc:503] Master 127.25.227.62:36979 was elected leader, sending a full tablet report...
W20260811 11:05:20.216473 28058 tablet.cc:2369] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:05:20.301874 27823 tablet.cc:2369] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:05:20.378726 28298 tablet.cc:2369] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:20.383257 28331 raft_consensus.cc:482] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:20.383371 28331 raft_consensus.cc:504] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.383833 28331 leader_election.cc:288] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de56db5f4aa14da3bb3b8fa7f01548a8 (127.25.227.2:35051), cdcdf26a496343ffb2bf5bef6ab6b679 (127.25.227.3:46589)
I20260811 11:05:20.386816 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.384187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:32975 (local address 127.25.227.2:35051)
0811 11:05:20.384271 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.384273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.384283 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:20.384345 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.384346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.384359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.384432 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:20.384585 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.385061 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.386081 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.386463 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.386555 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.386565 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.386708 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.386744 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:05:20.386883 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.384152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:39543 (local address 127.25.227.3:46589)
0811 11:05:20.384218 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.384221 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.384273 (+ 52us) server_negotiation.cc:407] Connection header received
0811 11:05:20.384360 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.384361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.384377 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.384444 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:20.384604 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.385064 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.386126 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.386518 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.386608 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.386617 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.386783 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.386818 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:05:20.386898 28333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.384029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:46589 (local address 127.25.227.1:39543)
0811 11:05:20.384204 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:20.384218 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:20.384291 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:20.384450 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:20.384451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:20.384454 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:20.384536 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.384537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.385152 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.385154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.386025 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.386028 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.386610 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.386611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.386701 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.386705 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:20.386774 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 11:05:20.386814 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":101,"threads_started":1}
I20260811 11:05:20.386940 28336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.384054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35051 (local address 127.25.227.1:32975)
0811 11:05:20.384214 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:20.384225 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:20.384284 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:20.384438 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:20.384439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:20.384441 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:20.384508 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.384510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.385151 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.385152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.385974 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:20.385977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.386555 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.386556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:20.386624 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.386627 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:20.386690 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 11:05:20.386735 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":86,"threads_started":1}
I20260811 11:05:20.387271 28212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db96c04573304cd397a4921ef6931834" candidate_uuid: "09624473879445a8b7e32c1d733a7f5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" is_pre_election: true
I20260811 11:05:20.387398 28212 raft_consensus.cc:2454] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09624473879445a8b7e32c1d733a7f5b in term 0.
I20260811 11:05:20.387770 27638 leader_election.cc:302] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09624473879445a8b7e32c1d733a7f5b, cdcdf26a496343ffb2bf5bef6ab6b679; no voters:
I20260811 11:05:20.387813 27973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db96c04573304cd397a4921ef6931834" candidate_uuid: "09624473879445a8b7e32c1d733a7f5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" is_pre_election: true
I20260811 11:05:20.387954 27973 raft_consensus.cc:2454] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09624473879445a8b7e32c1d733a7f5b in term 0.
I20260811 11:05:20.387941 28331 raft_consensus.cc:2781] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:20.388039 28331 raft_consensus.cc:482] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:20.388082 28331 raft_consensus.cc:3037] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:20.388835 28331 raft_consensus.cc:504] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.388988 28331 leader_election.cc:288] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [CANDIDATE]: Term 1 election: Requested vote from peers de56db5f4aa14da3bb3b8fa7f01548a8 (127.25.227.2:35051), cdcdf26a496343ffb2bf5bef6ab6b679 (127.25.227.3:46589)
I20260811 11:05:20.389114 27973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db96c04573304cd397a4921ef6931834" candidate_uuid: "09624473879445a8b7e32c1d733a7f5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8"
I20260811 11:05:20.389139 28212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db96c04573304cd397a4921ef6931834" candidate_uuid: "09624473879445a8b7e32c1d733a7f5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679"
I20260811 11:05:20.389236 28212 raft_consensus.cc:3037] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:20.389230 27973 raft_consensus.cc:3037] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:20.390386 27973 raft_consensus.cc:2454] T db96c04573304cd397a4921ef6931834 P de56db5f4aa14da3bb3b8fa7f01548a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09624473879445a8b7e32c1d733a7f5b in term 1.
I20260811 11:05:20.390386 28212 raft_consensus.cc:2454] T db96c04573304cd397a4921ef6931834 P cdcdf26a496343ffb2bf5bef6ab6b679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09624473879445a8b7e32c1d733a7f5b in term 1.
I20260811 11:05:20.390558 27638 leader_election.cc:302] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09624473879445a8b7e32c1d733a7f5b, cdcdf26a496343ffb2bf5bef6ab6b679; no voters:
I20260811 11:05:20.390663 28331 raft_consensus.cc:2781] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:20.390832 28331 raft_consensus.cc:686] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [term 1 LEADER]: Becoming Leader. State: Replica: 09624473879445a8b7e32c1d733a7f5b, State: Running, Role: LEADER
I20260811 11:05:20.390954 28331 consensus_queue.cc:237] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } }
I20260811 11:05:20.391827 27508 catalog_manager.cc:5495] T db96c04573304cd397a4921ef6931834 P 09624473879445a8b7e32c1d733a7f5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 09624473879445a8b7e32c1d733a7f5b (127.25.227.1). New cstate: current_term: 1 leader_uuid: "09624473879445a8b7e32c1d733a7f5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de56db5f4aa14da3bb3b8fa7f01548a8" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09624473879445a8b7e32c1d733a7f5b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 35569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdcdf26a496343ffb2bf5bef6ab6b679" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 46589 } health_report { overall_health: UNKNOWN } } }
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:20.447603 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.439514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36628 (local address 127.25.227.1:35569)
0811 11:05:20.439591 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.439594 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.439691 (+ 97us) server_negotiation.cc:407] Connection header received
0811 11:05:20.439744 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.439745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.439768 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.439813 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:20.440402 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.440871 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.441631 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.441858 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.441926 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.444547 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:20.444566 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:20.444567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:20.444573 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:20.446340 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.446716 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.446719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.446720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.446801 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.447019 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.447020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.447020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.447178 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:20.447367 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.447405 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.447487 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446320, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446320, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:20.474543 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.467306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36644 (local address 127.25.227.1:35569)
0811 11:05:20.467389 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.467391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.467418 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:05:20.467494 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.467495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.467504 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.467556 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:20.468145 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.468662 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.469446 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.469637 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.469695 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.472076 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:20.472077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:20.472077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:20.472099 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:20.473461 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.473779 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.473780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.473780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.473835 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.474007 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.474007 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.474008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.474098 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:20.474172 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.474329 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.474397 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[27432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:20.500530 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:20.493332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.25.227.1:35569)
0811 11:05:20.493415 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:20.493418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:20.493532 (+ 114us) server_negotiation.cc:407] Connection header received
0811 11:05:20.493618 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:20.493620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:20.493629 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:20.493701 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:20.494304 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.494782 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.495501 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:20.495696 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:20.495773 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:20.497978 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:20.497980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:20.497980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:20.497987 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:20.499279 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.499631 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.499632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.499633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.499714 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:20.499965 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:20.499966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:20.499967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:20.500087 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:20.500216 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:20.500337 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 11:05:20.500420 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 11:05:20.501366 27680 tablet_service.cc:2908] Rejecting scan request for tablet db96c04573304cd397a4921ef6931834: Uninitialized: clean time has not yet been initialized
I20260811 11:05:20.502312 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27604
I20260811 11:05:20.515892 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27830
I20260811 11:05:20.526381 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28064
I20260811 11:05:20.536000 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27461
2026-08-11T11:05:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2491 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[28360](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[28360](info): set up 2 sockets
Aug 11 11:05:20 dist-test-slave-z8x9 krb5kdc[28360](info): commencing operation
krb5kdc: starting...
W20260811 11:05:21.843628 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:21 dist-test-slave-z8x9 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:21.964048 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40989
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:40989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:22.047994 28385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:22.048235 28385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:22.048285 28385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:22.049499 28385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:22.049559 28385 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 11:05:22.049580 28385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:22.049600 28385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:22.049633 28385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:22.049657 28385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:22.051147 28385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:40989
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:22.051433 28385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:22.051674 28385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:22.056638 28398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:22.056744 28399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:22.056762 28385 server_base.cc:1034] running on GCE node
W20260811 11:05:22.056679 28404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:22.057113 28385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:22.057477 28385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:22.058620 28385 hybrid_clock.cc:648] HybridClock initialized: now 1786446322058601 us; error 39 us; skew 500 ppm
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:22.061117 28385 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:22.061574 28385 webserver.cc:460] Webserver started at http://127.25.227.62:41929/ using document root <none> and password file <none>
I20260811 11:05:22.061836 28385 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:22.061884 28385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:22.062062 28385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:22.063114 28385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "73080f0916dc42d9b0bdf9d52518c330"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "a474f046df14875030d16c927a169b1b"
server_key_iv: "b1f407a19adc62492531f22f152398c8"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.063478 28385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "73080f0916dc42d9b0bdf9d52518c330"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "a474f046df14875030d16c927a169b1b"
server_key_iv: "b1f407a19adc62492531f22f152398c8"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.064922 28385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:22.065717 28419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.065917 28385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.066010 28385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "73080f0916dc42d9b0bdf9d52518c330"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "a474f046df14875030d16c927a169b1b"
server_key_iv: "b1f407a19adc62492531f22f152398c8"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.066084 28385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:22.100678 28385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:22.102792 28385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:22.102969 28385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:22.108078 28385 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:40989
I20260811 11:05:22.108183 28518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:40989 every 8 connection(s)
I20260811 11:05:22.108516 28385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:22.109220 28520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.109911 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28385
I20260811 11:05:22.109992 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:22.110172 26508 external_mini_cluster.cc:1428] Setting key 8e5eda6cf53ead7a1afb46b8503cb131
I20260811 11:05:22.112383 28520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: Bootstrap starting.
I20260811 11:05:22.113214 28520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.113565 28520 log.cc:824] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:22.114256 28520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: No bootstrap required, opened a new log
I20260811 11:05:22.116123 28520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73080f0916dc42d9b0bdf9d52518c330" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40989 } }
I20260811 11:05:22.116256 28520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.116284 28520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73080f0916dc42d9b0bdf9d52518c330, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.116418 28520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73080f0916dc42d9b0bdf9d52518c330" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40989 } }
I20260811 11:05:22.116493 28520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:22.116515 28520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:22.116585 28520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.117398 28520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73080f0916dc42d9b0bdf9d52518c330" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40989 } }
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:22.117511 28520 leader_election.cc:302] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73080f0916dc42d9b0bdf9d52518c330; no voters:
I20260811 11:05:22.117692 28520 leader_election.cc:288] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:22.117754 28538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:22.117970 28538 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [term 1 LEADER]: Becoming Leader. State: Replica: 73080f0916dc42d9b0bdf9d52518c330, State: Running, Role: LEADER
I20260811 11:05:22.118018 28520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:22.118072 28538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73080f0916dc42d9b0bdf9d52518c330" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40989 } }
I20260811 11:05:22.118430 28538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73080f0916dc42d9b0bdf9d52518c330. Latest consensus state: current_term: 1 leader_uuid: "73080f0916dc42d9b0bdf9d52518c330" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73080f0916dc42d9b0bdf9d52518c330" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40989 } } }
I20260811 11:05:22.118522 28538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:22.118438 28541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73080f0916dc42d9b0bdf9d52518c330" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73080f0916dc42d9b0bdf9d52518c330" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40989 } } }
I20260811 11:05:22.118722 28541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:22.118757 28551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:22.119488 28551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:22.122435 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.110744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37168 (local address 127.25.227.62:40989)
0811 11:05:22.110951 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.110961 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.110995 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:05:22.111577 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.111587 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.111652 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.111811 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.112389 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.113854 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.114689 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.115118 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.115241 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.118127 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.118132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.118132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.118145 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.120377 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.120737 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.120740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.120741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.120862 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.121054 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.121055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.121055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.121375 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.121978 (+ 603us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.122051 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.122197 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260811 11:05:22.122774 28551 catalog_manager.cc:1347] Generated new cluster ID: 07d99ab0d7c34d9b9ed2a8a5af9ff618
I20260811 11:05:22.122828 28551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:22.130275 28551 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:22.131003 28551 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:22.141141 28551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: Generated new TSK 0
I20260811 11:05:22.141351 28551 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:22.170013 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40989
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:22.253979 28575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:22.254184 28575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:22.254209 28575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:22.255388 28575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:22.255429 28575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:22.255448 28575 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:22.255466 28575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:22.256877 28575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:40989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:22.257066 28575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:22.257278 28575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:22.262439 28587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:22.262435 28583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:22.262442 28582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:22.262457 28575 server_base.cc:1034] running on GCE node
I20260811 11:05:22.262884 28575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:22.263136 28575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:22.264313 28575 hybrid_clock.cc:648] HybridClock initialized: now 1786446322264287 us; error 38 us; skew 500 ppm
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:22.266963 28575 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:22.267433 28575 webserver.cc:460] Webserver started at http://127.25.227.1:43941/ using document root <none> and password file <none>
I20260811 11:05:22.267683 28575 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:22.267762 28575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:22.267912 28575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:22.269083 28575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "4794d1b53b3e4a3cb1f32484cb716208"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "7b7deb3a7fb8704b0238286e53151cfd"
server_key_iv: "593ad6b31f9349cbe0f80d3affdedf4c"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.269534 28575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "4794d1b53b3e4a3cb1f32484cb716208"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "7b7deb3a7fb8704b0238286e53151cfd"
server_key_iv: "593ad6b31f9349cbe0f80d3affdedf4c"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.271054 28575 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:05:22.271795 28598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.271967 28575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:22.272074 28575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "4794d1b53b3e4a3cb1f32484cb716208"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "7b7deb3a7fb8704b0238286e53151cfd"
server_key_iv: "593ad6b31f9349cbe0f80d3affdedf4c"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.272157 28575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:22.289958 28575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:22.292433 28575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:22.292606 28575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:22.293135 28575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:22.293236 28575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.293305 28575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:22.293332 28575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:22.300733 28575 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:40957
I20260811 11:05:22.300834 28817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:40957 every 8 connection(s)
I20260811 11:05:22.301237 28575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:22.303784 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.293868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:52279 (local address 127.25.227.62:40989)
0811 11:05:22.293916 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.293918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.294167 (+ 249us) server_negotiation.cc:407] Connection header received
0811 11:05:22.294711 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.294712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.294727 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.294814 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.295768 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.296628 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.297949 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.298190 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.298283 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.301127 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.301129 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.301129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.301139 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.302622 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.302993 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.302994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.302994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.303048 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.303228 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.303229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.303229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.303350 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.303400 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.303641 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.303714 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 11:05:22.303946 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.293877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.25.227.1:52279)
0811 11:05:22.294044 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.294080 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.294591 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.294899 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.294903 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.295340 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.295639 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.295646 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.296739 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.296740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.297853 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.297856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.298322 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.298323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.298452 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.299488 (+ 1036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.299496 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.301018 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.302694 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.302702 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.302703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.302926 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.303088 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.303089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.303089 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.303172 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.303409 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.303415 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.303527 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.303609 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.303728 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260811 11:05:22.304497 28818 heartbeater.cc:347] Connected to a master server at 127.25.227.62:40989
I20260811 11:05:22.304582 28818 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:22.304780 28818 heartbeater.cc:511] Master 127.25.227.62:40989 requested a full tablet report, sending...
I20260811 11:05:22.305341 28447 ts_manager.cc:194] Registered new tserver with Master: 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957)
I20260811 11:05:22.305814 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28575
I20260811 11:05:22.305936 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:22.306114 26508 external_mini_cluster.cc:1428] Setting key 5157c11055925a6128120244793f36d7
I20260811 11:05:22.306245 28447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:52279
I20260811 11:05:22.312237 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.305661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.25.227.1:38517)
0811 11:05:22.305807 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.305819 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.305875 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.306677 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.306678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.306959 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.307020 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.307022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.307654 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.307655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.308163 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.308164 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.308544 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.308545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.308626 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.309070 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.309075 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.309454 (+ 379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.311243 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.311253 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.311253 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.311425 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.311670 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.311671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.311671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.311728 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.312003 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.312003 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.312041 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.312090 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.312167 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260811 11:05:22.312422 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.306492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:38517 (local address 127.25.227.62:40989)
0811 11:05:22.306547 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.306550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.306559 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:22.306581 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.306582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.306592 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.306657 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.307103 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.307559 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.308248 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.308458 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.308534 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.309560 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.309561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.309561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.309569 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.311159 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.311529 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.311531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.311531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.311597 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.311799 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.311799 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.311800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.311935 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.312009 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.312116 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.312198 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:22.331699 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40989
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:22.417935 28829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:22.418167 28829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:22.418211 28829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:22.419432 28829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:22.419494 28829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:22.419528 28829 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:22.419569 28829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:22.421018 28829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:40989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:22.421304 28829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:22.421530 28829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:22.426564 28841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:22.426656 28829 server_base.cc:1034] running on GCE node
W20260811 11:05:22.426717 28843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:22.426783 28839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:22.427030 28829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:22.427248 28829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:22.428390 28829 hybrid_clock.cc:648] HybridClock initialized: now 1786446322428378 us; error 28 us; skew 500 ppm
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:22.430961 28829 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:22.431401 28829 webserver.cc:460] Webserver started at http://127.25.227.2:37661/ using document root <none> and password file <none>
I20260811 11:05:22.431656 28829 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:22.431704 28829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:22.431836 28829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:22.432941 28829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "5f0dcdc0969c42a9a261e9d4d192087a"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "82058c759eaadf402f62c32410f5692a"
server_key_iv: "e6efc4229adc71a2f4ae88d4e2b9429a"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.433336 28829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "5f0dcdc0969c42a9a261e9d4d192087a"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "82058c759eaadf402f62c32410f5692a"
server_key_iv: "e6efc4229adc71a2f4ae88d4e2b9429a"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.434964 28829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:22.435827 28855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.436025 28829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:22.436120 28829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "5f0dcdc0969c42a9a261e9d4d192087a"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "82058c759eaadf402f62c32410f5692a"
server_key_iv: "e6efc4229adc71a2f4ae88d4e2b9429a"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.436194 28829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:22.466573 28829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:22.468945 28829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:22.469110 28829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:22.469714 28829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:22.469790 28829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.469841 28829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:22.469868 28829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.477916 28829 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:38603
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:22.478020 29058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:38603 every 8 connection(s)
I20260811 11:05:22.478340 28829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:22.481544 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.470397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:58499 (local address 127.25.227.62:40989)
0811 11:05:22.470442 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.470444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.470816 (+ 372us) server_negotiation.cc:407] Connection header received
0811 11:05:22.471313 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.471315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.471329 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.471420 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.472473 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.473345 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.475085 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.475398 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.475452 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.478555 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.478557 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.478557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.478566 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.480064 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.480485 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.480487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.480488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.480555 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.480820 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.480821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.480822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.480942 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.481014 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.481367 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.481450 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:05:22.481742 28871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.470398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.25.227.2:58499)
0811 11:05:22.470655 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.470708 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.471212 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.471579 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.471585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.472031 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.472344 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.472351 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.473447 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.473449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.474984 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.474987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.475494 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.475496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.475657 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.476308 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.476320 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.478417 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.480172 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.480178 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.480181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.480408 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.480632 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.480633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.480634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.480745 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.481017 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.481024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.481209 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.481342 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.481506 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":132,"threads_started":1}
I20260811 11:05:22.482250 29059 heartbeater.cc:347] Connected to a master server at 127.25.227.62:40989
I20260811 11:05:22.482336 29059 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:22.482534 29059 heartbeater.cc:511] Master 127.25.227.62:40989 requested a full tablet report, sending...
I20260811 11:05:22.482944 28446 ts_manager.cc:194] Registered new tserver with Master: 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2:38603)
I20260811 11:05:22.483440 28446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:58499
I20260811 11:05:22.487547 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28829
I20260811 11:05:22.487622 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:22.487820 26508 external_mini_cluster.cc:1428] Setting key a82fa65fb480f56a0548e90e3adf4300
I20260811 11:05:22.489250 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.483383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:49735 (local address 127.25.227.62:40989)
0811 11:05:22.483431 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.483433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.483518 (+ 85us) server_negotiation.cc:407] Connection header received
0811 11:05:22.483624 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.483625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.483637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.483704 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.484005 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.484468 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.485196 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.485396 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.485482 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.486404 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.486405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.486406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.486412 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.487999 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.488375 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.488376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.488377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.488442 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.488660 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.488661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.488662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.488821 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.488899 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.489070 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.489141 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:05:22.489259 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.483316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.25.227.2:49735)
0811 11:05:22.483456 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.483467 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.483543 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.483707 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.483707 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.483866 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.483926 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.483927 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.484561 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.484562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.485071 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.485072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.485485 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.485486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.485560 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.485999 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.486004 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.486295 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.488098 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.488100 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.488100 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.488303 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.488514 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.488515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.488515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.488592 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.488901 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.488902 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.488948 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.489029 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.489136 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:22.514210 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40989
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:22.599603 29079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:22.599817 29079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:22.599841 29079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:22.601009 29079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:22.601056 29079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:22.601078 29079 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:22.601136 29079 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:22.602664 29079 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:40989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:22.602911 29079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:22.603147 29079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:22.608542 29091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:22.608569 29087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:22.608569 29088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:22.608902 29079 server_base.cc:1034] running on GCE node
I20260811 11:05:22.609064 29079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:22.609347 29079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:22.610514 29079 hybrid_clock.cc:648] HybridClock initialized: now 1786446322610504 us; error 26 us; skew 500 ppm
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:22.613091 29079 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:22.613656 29079 webserver.cc:460] Webserver started at http://127.25.227.3:38719/ using document root <none> and password file <none>
I20260811 11:05:22.613902 29079 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:22.613976 29079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:22.614135 29079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:22.615219 29079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "626ce44bbbdb45f4a4a5c82ff2041233"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "d9f35d959befdab07d1f8222e3877920"
server_key_iv: "a7a22aad79812ced20752f191a7ce7c2"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.615599 29079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "626ce44bbbdb45f4a4a5c82ff2041233"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "d9f35d959befdab07d1f8222e3877920"
server_key_iv: "a7a22aad79812ced20752f191a7ce7c2"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.616956 29079 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:05:22.617873 29099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.618057 29079 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:22.618165 29079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "626ce44bbbdb45f4a4a5c82ff2041233"
format_stamp: "Formatted at 2026-08-11 11:05:22 on dist-test-slave-z8x9"
server_key: "d9f35d959befdab07d1f8222e3877920"
server_key_iv: "a7a22aad79812ced20752f191a7ce7c2"
server_key_version: "encryptionkey@0"
I20260811 11:05:22.618242 29079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:22.634699 29079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:22.637270 29079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:22.637434 29079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:22.638020 29079 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:22.638082 29079 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.638126 29079 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:22.638154 29079 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:22.646896 29079 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:37439
I20260811 11:05:22.646925 29281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:37439 every 8 connection(s)
I20260811 11:05:22.647298 29079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:22.648528 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.638465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:42335 (local address 127.25.227.62:40989)
0811 11:05:22.638532 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.638535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.638744 (+ 209us) server_negotiation.cc:407] Connection header received
0811 11:05:22.639289 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.639291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.639306 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.639395 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.640172 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.641044 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.642118 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.642492 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.642664 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.645103 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.645105 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.645105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.645115 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.647020 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.647453 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.647455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.647455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.647511 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.647830 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.647832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.647832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.647984 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.648063 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.648350 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.648433 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:05:22.648707 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.638452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.25.227.3:42335)
0811 11:05:22.638604 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.638645 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.639188 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.639445 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.639448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.639734 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.640033 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.640040 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.641152 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.641153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.642046 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.642049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.642700 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.642702 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.642859 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.643402 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.643412 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.645025 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.647109 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.647114 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.647116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.647354 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.647587 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.647588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.647588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.647745 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.648067 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.648074 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.648208 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.648323 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.648483 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260811 11:05:22.649230 29286 heartbeater.cc:347] Connected to a master server at 127.25.227.62:40989
I20260811 11:05:22.649326 29286 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:22.649509 29286 heartbeater.cc:511] Master 127.25.227.62:40989 requested a full tablet report, sending...
I20260811 11:05:22.649892 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29079
I20260811 11:05:22.649971 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:22.650146 26508 external_mini_cluster.cc:1428] Setting key f3d977bfb1c5f09a5735a808c9ad530a
I20260811 11:05:22.650498 28446 ts_manager.cc:194] Registered new tserver with Master: 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439)
I20260811 11:05:22.651017 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:05:22.651028 28446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:42335
I20260811 11:05:22.656239 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.650322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:60977 (local address 127.25.227.62:40989)
0811 11:05:22.650365 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.650367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.650576 (+ 209us) server_negotiation.cc:407] Connection header received
0811 11:05:22.650667 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.650668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.650679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.650730 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.651067 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.651735 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.652413 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.652708 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.652789 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.653844 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.653845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.653846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.653852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.655115 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.655521 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.655522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.655522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.655573 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.655781 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.655782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.655782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.655876 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.655925 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.656125 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.656181 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:05:22.656373 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.650271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.25.227.3:60977)
0811 11:05:22.650518 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.650530 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.650586 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.650736 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.650737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.650933 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.650998 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.650999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.651854 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.651855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.652332 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.652334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.652788 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.652789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.652846 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.653299 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.653306 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.653743 (+ 437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.655198 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.655199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.655200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.655445 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.655636 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.655637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.655637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.655715 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.655944 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.655945 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.656002 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.656113 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.656237 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":70,"threads_started":1}
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:22.679280 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.672232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58598 (local address 127.25.227.62:40989)
0811 11:05:22.672301 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.672303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.672338 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:05:22.672369 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.672370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.672379 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.672420 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.672975 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.673539 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.674255 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.674524 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.674582 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.676848 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.676849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.676850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.676857 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.678236 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.678566 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.678567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.678568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.678626 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.678802 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.678803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.678803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.678909 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.678988 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.679087 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.679149 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:05:22.680920 28446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:22.682767 28446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:22.689232 29313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.685001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:38603 (local address 127.0.0.1:43908)
0811 11:05:22.685440 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.685452 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.685598 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.685793 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.685796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.685799 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.685872 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.685875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.686808 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.686809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.687929 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.687932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.688893 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.688894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.688973 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.688985 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.689062 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.689122 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":5,"thread_start_us":62,"threads_started":1}
I20260811 11:05:22.689239 29314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.685062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:40957 (local address 127.0.0.1:39384)
0811 11:05:22.685679 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.685687 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.685731 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.686000 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.686000 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.686002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.686046 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.686047 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.687332 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.687333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.688230 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.688232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.689024 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.689025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.689083 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.689087 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.689133 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.689164 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":82,"threads_started":1}
I20260811 11:05:22.689450 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.685327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.25.227.1:40957)
0811 11:05:22.685638 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.685642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.685794 (+ 152us) server_negotiation.cc:407] Connection header received
0811 11:05:22.685842 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.685845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.685860 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.685931 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.686124 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.687224 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.688333 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.688837 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.688929 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.688990 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.689282 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.689328 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":89,"threads_started":1}
I20260811 11:05:22.689311 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.685217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43908 (local address 127.25.227.2:38603)
0811 11:05:22.685542 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.685546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.685609 (+ 63us) server_negotiation.cc:407] Connection header received
0811 11:05:22.685661 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.685663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.685679 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.685775 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.685965 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.686710 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.688031 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.688800 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.688873 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.688927 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.689094 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.689140 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":118,"threads_started":1}
I20260811 11:05:22.690049 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.685000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:37439 (local address 127.0.0.1:52336)
0811 11:05:22.685113 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.685155 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.685259 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.685921 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.685922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.685924 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.685981 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.685983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.687321 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.687322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.688444 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.688447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.689843 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.689844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.689910 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.689914 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.689946 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.689982 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":26,"thread_start_us":106,"threads_started":1}
I20260811 11:05:22.690219 28690 tablet_service.cc:1467] Processing CreateTablet for tablet 77c11cf6e35241b69746d399cf6f91fd (DEFAULT_TABLE table=test-table [id=75ec165942d941c889e9bd1eadd217df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:22.690399 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.685295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52336 (local address 127.25.227.3:37439)
0811 11:05:22.685557 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.685562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.685573 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:05:22.685616 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.685619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.685636 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.686064 (+ 428us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.686131 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.687224 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.688538 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.689412 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.690171 (+ 759us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.690237 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.690265 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.690304 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":112,"threads_started":1}
I20260811 11:05:22.690284 28941 tablet_service.cc:1467] Processing CreateTablet for tablet 77c11cf6e35241b69746d399cf6f91fd (DEFAULT_TABLE table=test-table [id=75ec165942d941c889e9bd1eadd217df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:22.690623 28690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c11cf6e35241b69746d399cf6f91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.690636 28941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c11cf6e35241b69746d399cf6f91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.693619 29321 tablet_bootstrap.cc:492] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Bootstrap starting.
I20260811 11:05:22.693884 29177 tablet_service.cc:1467] Processing CreateTablet for tablet 77c11cf6e35241b69746d399cf6f91fd (DEFAULT_TABLE table=test-table [id=75ec165942d941c889e9bd1eadd217df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:22.694223 29177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c11cf6e35241b69746d399cf6f91fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.694306 29321 tablet_bootstrap.cc:654] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.694634 29321 log.cc:824] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:22.694996 29322 tablet_bootstrap.cc:492] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Bootstrap starting.
I20260811 11:05:22.695386 29321 tablet_bootstrap.cc:492] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: No bootstrap required, opened a new log
I20260811 11:05:22.695477 29321 ts_tablet_manager.cc:1397] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:22.695647 29322 tablet_bootstrap.cc:654] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.696125 29322 log.cc:824] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:22.696925 29322 tablet_bootstrap.cc:492] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: No bootstrap required, opened a new log
I20260811 11:05:22.696992 29322 ts_tablet_manager.cc:1397] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:22.697561 29326 tablet_bootstrap.cc:492] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Bootstrap starting.
I20260811 11:05:22.697527 29321 raft_consensus.cc:348] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.697702 29321 raft_consensus.cc:374] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.697762 29321 raft_consensus.cc:729] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4794d1b53b3e4a3cb1f32484cb716208, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.697922 29321 consensus_queue.cc:260] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.698204 29321 ts_tablet_manager.cc:1428] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:05:22.698340 28818 heartbeater.cc:503] Master 127.25.227.62:40989 was elected leader, sending a full tablet report...
I20260811 11:05:22.698645 29326 tablet_bootstrap.cc:654] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.698946 29326 log.cc:824] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:22.699061 29322 raft_consensus.cc:348] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.699225 29322 raft_consensus.cc:374] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.699288 29322 raft_consensus.cc:729] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0dcdc0969c42a9a261e9d4d192087a, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.699409 29322 consensus_queue.cc:260] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.699749 29326 tablet_bootstrap.cc:492] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: No bootstrap required, opened a new log
I20260811 11:05:22.699764 29322 ts_tablet_manager.cc:1428] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:05:22.699812 29059 heartbeater.cc:503] Master 127.25.227.62:40989 was elected leader, sending a full tablet report...
I20260811 11:05:22.699836 29326 ts_tablet_manager.cc:1397] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:22.701512 29326 raft_consensus.cc:348] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.701632 29326 raft_consensus.cc:374] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.701653 29326 raft_consensus.cc:729] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626ce44bbbdb45f4a4a5c82ff2041233, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.701800 29326 consensus_queue.cc:260] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.702052 29326 ts_tablet_manager.cc:1428] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 11:05:22.702111 29286 heartbeater.cc:503] Master 127.25.227.62:40989 was elected leader, sending a full tablet report...
I20260811 11:05:22.709116 29329 raft_consensus.cc:482] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:22.709251 29329 raft_consensus.cc:504] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.709785 29329 leader_election.cc:288] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439), 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957)
I20260811 11:05:22.713069 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.709823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:59233 (local address 127.25.227.3:37439)
0811 11:05:22.709871 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.709873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.709883 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:22.709917 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.709918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.709928 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.709999 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.710140 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.710861 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.712198 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.712739 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.712817 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.712825 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.712962 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.713001 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:22.713078 28871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.709764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:37439 (local address 127.25.227.2:59233)
0811 11:05:22.709822 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.709834 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.709873 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.710005 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.710006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.710008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.710075 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.710077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.710937 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.710938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.712109 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.712112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.712818 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.712819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.712885 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.712889 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.712932 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.712991 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:05:22.713359 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.709830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:46873 (local address 127.25.227.1:40957)
0811 11:05:22.709884 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.709886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.710133 (+ 247us) server_negotiation.cc:407] Connection header received
0811 11:05:22.710179 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.710180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.710190 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.710237 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.710430 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.711071 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.712337 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.712889 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.712980 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.712988 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.713224 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.713285 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:05:22.713440 29331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.709769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:40957 (local address 127.25.227.2:46873)
0811 11:05:22.710059 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.710069 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.710124 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.710242 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.710242 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.710243 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.710361 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.710363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.711136 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.711137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.712265 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.712267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.712988 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.712989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.713088 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.713093 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.713210 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.713254 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":139,"thread_start_us":99,"threads_started":1}
I20260811 11:05:22.713461 29216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c11cf6e35241b69746d399cf6f91fd" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" is_pre_election: true
I20260811 11:05:22.713591 29216 raft_consensus.cc:2454] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 0.
I20260811 11:05:22.713761 28729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c11cf6e35241b69746d399cf6f91fd" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4794d1b53b3e4a3cb1f32484cb716208" is_pre_election: true
I20260811 11:05:22.713810 28857 leader_election.cc:302] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0dcdc0969c42a9a261e9d4d192087a, 626ce44bbbdb45f4a4a5c82ff2041233; no voters:
I20260811 11:05:22.713919 28729 raft_consensus.cc:2454] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 0.
I20260811 11:05:22.713946 29329 raft_consensus.cc:2781] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:22.713985 29329 raft_consensus.cc:482] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:22.714017 29329 raft_consensus.cc:3037] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.714917 29329 raft_consensus.cc:504] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.715062 29329 leader_election.cc:288] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 election: Requested vote from peers 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439), 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957)
I20260811 11:05:22.715221 28729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c11cf6e35241b69746d399cf6f91fd" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4794d1b53b3e4a3cb1f32484cb716208"
I20260811 11:05:22.715315 28729 raft_consensus.cc:3037] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.716132 28729 raft_consensus.cc:2454] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 1.
I20260811 11:05:22.716274 29216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c11cf6e35241b69746d399cf6f91fd" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "626ce44bbbdb45f4a4a5c82ff2041233"
I20260811 11:05:22.716341 28862 leader_election.cc:302] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4794d1b53b3e4a3cb1f32484cb716208, 5f0dcdc0969c42a9a261e9d4d192087a; no voters:
I20260811 11:05:22.716363 29216 raft_consensus.cc:3037] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.717036 29216 raft_consensus.cc:2454] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 1.
I20260811 11:05:22.717185 29329 raft_consensus.cc:2781] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:22.717355 29329 raft_consensus.cc:686] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 LEADER]: Becoming Leader. State: Replica: 5f0dcdc0969c42a9a261e9d4d192087a, State: Running, Role: LEADER
I20260811 11:05:22.717428 29329 consensus_queue.cc:237] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } }
I20260811 11:05:22.718299 28446 catalog_manager.cc:5495] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2). New cstate: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:22.728964 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.726629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43924 (local address 127.25.227.2:38603)
0811 11:05:22.726669 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.726671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.726707 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:05:22.726803 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.726804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.726818 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.726878 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:22.727017 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.727470 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.728230 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.728429 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.728493 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.728681 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:22.728771 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:22.728831 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.728880 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.728898 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 11:05:22.729190 29061 tablet.cc:2369] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:22.730741 29216 raft_consensus.cc:1261] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Refusing update from remote peer 5f0dcdc0969c42a9a261e9d4d192087a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:22.730742 28729 raft_consensus.cc:1261] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Refusing update from remote peer 5f0dcdc0969c42a9a261e9d4d192087a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:22.731199 29329 consensus_queue.cc:1035] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [LEADER]: Connected to new peer: Peer: permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:22.731454 29333 consensus_queue.cc:1035] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:22.734139 29338 mvcc.cc:205] Tried to move back new op lower bound from 7317284137902383104 to 7317284137851260928. Current Snapshot: MvccSnapshot[applied={T|T < 7317284137902383104}]
I20260811 11:05:22.734268 29342 mvcc.cc:205] Tried to move back new op lower bound from 7317284137902383104 to 7317284137851260928. Current Snapshot: MvccSnapshot[applied={T|T < 7317284137902383104}]
I20260811 11:05:22.738651 28447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:22.738786 28447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:22.739588 28447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: Sending DeleteTablet for 3 replicas of tablet 77c11cf6e35241b69746d399cf6f91fd
I20260811 11:05:22.740125 28690 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c11cf6e35241b69746d399cf6f91fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:22 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39384
I20260811 11:05:22.740146 29177 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c11cf6e35241b69746d399cf6f91fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:22 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:52336
I20260811 11:05:22.740382 28941 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c11cf6e35241b69746d399cf6f91fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:22 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:43908
I20260811 11:05:22.740670 29360 tablet_replica.cc:330] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: stopping tablet replica
I20260811 11:05:22.740779 29360 raft_consensus.cc:2229] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:22.740723 28447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:22.740862 28447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:22.740895 29360 raft_consensus.cc:2258] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:22.741662 29360 ts_tablet_manager.cc:1905] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:22.742125 28941 tablet_service.cc:1467] Processing CreateTablet for tablet 65bbacf82b5049ad926e3de2afe7a735 (DEFAULT_TABLE table=test-table [id=8e3aaa5d07d844d39dd4b13b79db52a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:22.742193 29177 tablet_service.cc:1467] Processing CreateTablet for tablet 65bbacf82b5049ad926e3de2afe7a735 (DEFAULT_TABLE table=test-table [id=8e3aaa5d07d844d39dd4b13b79db52a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:22.742262 28941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65bbacf82b5049ad926e3de2afe7a735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.742358 29177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65bbacf82b5049ad926e3de2afe7a735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.743635 29322 tablet_bootstrap.cc:492] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Bootstrap starting.
I20260811 11:05:22.743788 29326 tablet_bootstrap.cc:492] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Bootstrap starting.
I20260811 11:05:22.744019 28690 tablet_service.cc:1467] Processing CreateTablet for tablet 65bbacf82b5049ad926e3de2afe7a735 (DEFAULT_TABLE table=test-table [id=8e3aaa5d07d844d39dd4b13b79db52a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:22.744141 28690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65bbacf82b5049ad926e3de2afe7a735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.744230 29322 tablet_bootstrap.cc:654] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.744463 29326 tablet_bootstrap.cc:654] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.744740 29357 tablet_replica.cc:330] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: stopping tablet replica
I20260811 11:05:22.744846 29357 raft_consensus.cc:2229] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:22.744976 29357 raft_consensus.cc:2258] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:22.745085 29359 tablet_replica.cc:330] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: stopping tablet replica
I20260811 11:05:22.745211 29359 raft_consensus.cc:2229] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:22.745343 29359 raft_consensus.cc:2258] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:22.745831 29359 ts_tablet_manager.cc:1905] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:22.745949 29321 tablet_bootstrap.cc:492] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Bootstrap starting.
I20260811 11:05:22.746289 29360 ts_tablet_manager.cc:1918] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:22.746366 29360 log.cc:1196] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/77c11cf6e35241b69746d399cf6f91fd
I20260811 11:05:22.746462 29321 tablet_bootstrap.cc:654] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.746649 29360 ts_tablet_manager.cc:1939] T 77c11cf6e35241b69746d399cf6f91fd P 5f0dcdc0969c42a9a261e9d4d192087a: Deleting consensus metadata
I20260811 11:05:22.747028 29322 tablet_bootstrap.cc:492] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: No bootstrap required, opened a new log
I20260811 11:05:22.747037 28425 catalog_manager.cc:4841] TS 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2:38603): tablet 77c11cf6e35241b69746d399cf6f91fd (table test-table [id=75ec165942d941c889e9bd1eadd217df]) successfully deleted
I20260811 11:05:22.747156 29322 ts_tablet_manager.cc:1397] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:05:22.747521 29326 tablet_bootstrap.cc:492] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: No bootstrap required, opened a new log
I20260811 11:05:22.747475 29322 raft_consensus.cc:348] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.747579 29326 ts_tablet_manager.cc:1397] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:05:22.747682 29322 raft_consensus.cc:374] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.747709 29326 raft_consensus.cc:348] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.747783 29326 raft_consensus.cc:374] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.747813 29326 raft_consensus.cc:729] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626ce44bbbdb45f4a4a5c82ff2041233, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.747762 29322 raft_consensus.cc:729] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0dcdc0969c42a9a261e9d4d192087a, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.747859 29326 consensus_queue.cc:260] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.747975 29326 ts_tablet_manager.cc:1428] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:22.748368 29322 consensus_queue.cc:260] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.748592 29359 ts_tablet_manager.cc:1918] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:22.748677 29359 log.cc:1196] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/77c11cf6e35241b69746d399cf6f91fd
I20260811 11:05:22.748580 29322 ts_tablet_manager.cc:1428] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:05:22.749008 29359 ts_tablet_manager.cc:1939] T 77c11cf6e35241b69746d399cf6f91fd P 4794d1b53b3e4a3cb1f32484cb716208: Deleting consensus metadata
I20260811 11:05:22.749285 29357 ts_tablet_manager.cc:1905] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:22.749471 28421 catalog_manager.cc:4841] TS 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957): tablet 77c11cf6e35241b69746d399cf6f91fd (table test-table [id=75ec165942d941c889e9bd1eadd217df]) successfully deleted
I20260811 11:05:22.749765 29321 tablet_bootstrap.cc:492] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: No bootstrap required, opened a new log
I20260811 11:05:22.749830 29321 ts_tablet_manager.cc:1397] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:05:22.749985 29321 raft_consensus.cc:348] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.750063 29321 raft_consensus.cc:374] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.750092 29321 raft_consensus.cc:729] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4794d1b53b3e4a3cb1f32484cb716208, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.750147 29321 consensus_queue.cc:260] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.750263 29321 ts_tablet_manager.cc:1428] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:22.751159 29357 ts_tablet_manager.cc:1918] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:22.751221 29357 log.cc:1196] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/77c11cf6e35241b69746d399cf6f91fd
I20260811 11:05:22.751405 29357 ts_tablet_manager.cc:1939] T 77c11cf6e35241b69746d399cf6f91fd P 626ce44bbbdb45f4a4a5c82ff2041233: Deleting consensus metadata
I20260811 11:05:22.751811 28420 catalog_manager.cc:4841] TS 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439): tablet 77c11cf6e35241b69746d399cf6f91fd (table test-table [id=75ec165942d941c889e9bd1eadd217df]) successfully deleted
W20260811 11:05:22.802007 28820 tablet.cc:2369] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:22.851697 29330 raft_consensus.cc:482] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:22.851831 29330 raft_consensus.cc:504] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.852236 29330 leader_election.cc:288] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957), 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2:38603)
I20260811 11:05:22.856062 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.852586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:38935 (local address 127.25.227.2:38603)
0811 11:05:22.852635 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.852637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.852865 (+ 228us) server_negotiation.cc:407] Connection header received
0811 11:05:22.852897 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.852899 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.852910 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.852985 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.853288 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.853954 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.855067 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.855623 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.855700 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.855709 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.855944 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.855992 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:22.856123 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.852464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:38603 (local address 127.25.227.3:38935)
0811 11:05:22.852782 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.852792 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.852851 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.853008 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.853009 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.853011 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.853195 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.853197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.854037 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.854039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.854966 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.854969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.855724 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.855725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.855809 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.855814 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.855927 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.855971 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":174,"thread_start_us":71,"threads_started":1}
I20260811 11:05:22.856150 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.852463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:40957 (local address 127.25.227.3:59719)
0811 11:05:22.852522 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.852537 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.852585 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.852798 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.852800 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.852802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:22.852880 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.852882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.853860 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.853861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.855109 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.855112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.855857 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.855858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.855947 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.855951 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.856001 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.856041 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":3}
I20260811 11:05:22.856447 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.852599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:59719 (local address 127.25.227.1:40957)
0811 11:05:22.852647 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.852648 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.852657 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:22.852688 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.852689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.852699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.852760 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:22.852995 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.853775 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.855209 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.855775 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.855857 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.855866 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.856325 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.856378 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:05:22.856375 28970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65bbacf82b5049ad926e3de2afe7a735" candidate_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" is_pre_election: true
I20260811 11:05:22.856539 28970 raft_consensus.cc:2454] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 626ce44bbbdb45f4a4a5c82ff2041233 in term 0.
I20260811 11:05:22.856724 29105 leader_election.cc:302] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0dcdc0969c42a9a261e9d4d192087a, 626ce44bbbdb45f4a4a5c82ff2041233; no voters:
I20260811 11:05:22.856874 28729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65bbacf82b5049ad926e3de2afe7a735" candidate_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4794d1b53b3e4a3cb1f32484cb716208" is_pre_election: true
I20260811 11:05:22.856928 29330 raft_consensus.cc:2781] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:22.856967 29330 raft_consensus.cc:482] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:22.856988 29330 raft_consensus.cc:3037] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.856976 28729 raft_consensus.cc:2454] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 626ce44bbbdb45f4a4a5c82ff2041233 in term 0.
I20260811 11:05:22.857826 29330 raft_consensus.cc:504] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.857977 29330 leader_election.cc:288] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [CANDIDATE]: Term 1 election: Requested vote from peers 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957), 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2:38603)
I20260811 11:05:22.858140 28970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65bbacf82b5049ad926e3de2afe7a735" candidate_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f0dcdc0969c42a9a261e9d4d192087a"
I20260811 11:05:22.858240 28970 raft_consensus.cc:3037] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.858181 28729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65bbacf82b5049ad926e3de2afe7a735" candidate_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4794d1b53b3e4a3cb1f32484cb716208"
I20260811 11:05:22.858305 28729 raft_consensus.cc:3037] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:22.858827 28970 raft_consensus.cc:2454] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 626ce44bbbdb45f4a4a5c82ff2041233 in term 1.
I20260811 11:05:22.859016 29105 leader_election.cc:302] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f0dcdc0969c42a9a261e9d4d192087a, 626ce44bbbdb45f4a4a5c82ff2041233; no voters:
I20260811 11:05:22.859135 29330 raft_consensus.cc:2781] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:22.859263 29330 raft_consensus.cc:686] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 LEADER]: Becoming Leader. State: Replica: 626ce44bbbdb45f4a4a5c82ff2041233, State: Running, Role: LEADER
I20260811 11:05:22.859333 29330 consensus_queue.cc:237] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.859426 28729 raft_consensus.cc:2454] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 626ce44bbbdb45f4a4a5c82ff2041233 in term 1.
I20260811 11:05:22.860172 28446 catalog_manager.cc:5495] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 reported cstate change: term changed from 0 to 1, leader changed from <none> to 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3). New cstate: current_term: 1 leader_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } health_report { overall_health: HEALTHY } } }
W20260811 11:05:22.898008 29287 tablet.cc:2369] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 11:05:22 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:22.921279 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.913903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40989 (local address 127.0.0.1:58604)
0811 11:05:22.914131 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:22.914142 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:22.914208 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:22.914348 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:22.914349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:22.914691 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:22.914746 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.914748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.915370 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.915371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.915928 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:22.915929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.916238 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.916239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:22.916284 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.916849 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:22.916854 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:22.918623 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:22.920165 (+ 1542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.920172 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.920175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.920379 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.920561 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:22.920562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:22.920562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:22.920623 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:22.920885 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:22.920891 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:22.920932 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 11:05:22.920983 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:05:22.921141 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":151,"threads_started":1}
I20260811 11:05:22.921341 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:22.913950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58604 (local address 127.25.227.62:40989)
0811 11:05:22.914041 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:22.914044 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:22.914212 (+ 168us) server_negotiation.cc:407] Connection header received
0811 11:05:22.914271 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:22.914272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:22.914283 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:22.914326 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:22.914822 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.915304 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.916000 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:22.916174 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:22.916224 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:22.918703 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:22.918705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:22.918705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:22.918712 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:22.920095 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.920447 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.920448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.920448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.920502 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:22.920676 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:22.920694 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:22.920694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:22.920828 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:22.920882 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:22.921019 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 11:05:22.921248 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":60}
I20260811 11:05:22.923521 28446 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:58604:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 11:05:22.923712 28446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:22.925263 28690 tablet_service.cc:1467] Processing CreateTablet for tablet 9e79466ae12244df90fb44aca6f60a80 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=438f9e0ac9cb4d358a82412b0ee30e40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:22.925325 28941 tablet_service.cc:1467] Processing CreateTablet for tablet 9e79466ae12244df90fb44aca6f60a80 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=438f9e0ac9cb4d358a82412b0ee30e40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:22.925339 29177 tablet_service.cc:1467] Processing CreateTablet for tablet 9e79466ae12244df90fb44aca6f60a80 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=438f9e0ac9cb4d358a82412b0ee30e40]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:22.925462 28690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e79466ae12244df90fb44aca6f60a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.925503 28941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e79466ae12244df90fb44aca6f60a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.925501 29177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e79466ae12244df90fb44aca6f60a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:22.927035 29321 tablet_bootstrap.cc:492] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: Bootstrap starting.
I20260811 11:05:22.927275 29322 tablet_bootstrap.cc:492] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: Bootstrap starting.
I20260811 11:05:22.927292 29326 tablet_bootstrap.cc:492] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: Bootstrap starting.
I20260811 11:05:22.927718 29322 tablet_bootstrap.cc:654] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.927718 29321 tablet_bootstrap.cc:654] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.927847 29326 tablet_bootstrap.cc:654] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:22.928457 29322 tablet_bootstrap.cc:492] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: No bootstrap required, opened a new log
I20260811 11:05:22.928512 29322 ts_tablet_manager.cc:1397] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:22.928643 29322 raft_consensus.cc:348] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.928730 29322 raft_consensus.cc:374] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.928757 29322 raft_consensus.cc:729] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f0dcdc0969c42a9a261e9d4d192087a, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.928825 29322 consensus_queue.cc:260] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.928892 29326 tablet_bootstrap.cc:492] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: No bootstrap required, opened a new log
I20260811 11:05:22.928927 29322 ts_tablet_manager.cc:1428] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.928936 29326 ts_tablet_manager.cc:1397] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:22.929006 29346 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:22.929106 29346 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:22.929152 29326 raft_consensus.cc:348] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.929263 29326 raft_consensus.cc:374] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.929297 29326 raft_consensus.cc:729] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626ce44bbbdb45f4a4a5c82ff2041233, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.929354 29326 consensus_queue.cc:260] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.929445 29326 ts_tablet_manager.cc:1428] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:22.929483 29330 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:22.929543 29330 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:22.929636 29321 tablet_bootstrap.cc:492] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: No bootstrap required, opened a new log
I20260811 11:05:22.929690 29321 ts_tablet_manager.cc:1397] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 11:05:22.929857 29321 raft_consensus.cc:348] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.929929 29321 raft_consensus.cc:374] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:22.929950 29321 raft_consensus.cc:729] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4794d1b53b3e4a3cb1f32484cb716208, State: Initialized, Role: FOLLOWER
I20260811 11:05:22.930028 29321 consensus_queue.cc:260] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:22.930130 29321 ts_tablet_manager.cc:1428] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:22.930189 29327 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:22.930291 29327 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:23.065523 29346 raft_consensus.cc:482] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:23.065652 29346 raft_consensus.cc:504] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:23.065882 29346 leader_election.cc:288] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957), 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439)
I20260811 11:05:23.066125 28729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e79466ae12244df90fb44aca6f60a80" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4794d1b53b3e4a3cb1f32484cb716208" is_pre_election: true
I20260811 11:05:23.066274 28729 raft_consensus.cc:2454] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 0.
I20260811 11:05:23.066213 29216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e79466ae12244df90fb44aca6f60a80" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" is_pre_election: true
I20260811 11:05:23.066407 29216 raft_consensus.cc:2454] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 0.
I20260811 11:05:23.066457 28862 leader_election.cc:302] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4794d1b53b3e4a3cb1f32484cb716208, 5f0dcdc0969c42a9a261e9d4d192087a; no voters:
I20260811 11:05:23.066558 29346 raft_consensus.cc:2781] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:23.066603 29346 raft_consensus.cc:482] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:23.066627 29346 raft_consensus.cc:3037] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:23.067394 29346 raft_consensus.cc:504] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:23.067546 29346 leader_election.cc:288] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 election: Requested vote from peers 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957), 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439)
I20260811 11:05:23.067693 28729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e79466ae12244df90fb44aca6f60a80" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4794d1b53b3e4a3cb1f32484cb716208"
I20260811 11:05:23.067799 28729 raft_consensus.cc:3037] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:23.067775 29216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e79466ae12244df90fb44aca6f60a80" candidate_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "626ce44bbbdb45f4a4a5c82ff2041233"
I20260811 11:05:23.067914 29216 raft_consensus.cc:3037] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:23.068560 28729 raft_consensus.cc:2454] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 1.
I20260811 11:05:23.068784 28862 leader_election.cc:302] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4794d1b53b3e4a3cb1f32484cb716208, 5f0dcdc0969c42a9a261e9d4d192087a; no voters:
I20260811 11:05:23.068943 29346 raft_consensus.cc:2781] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:23.069036 29346 raft_consensus.cc:686] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 LEADER]: Becoming Leader. State: Replica: 5f0dcdc0969c42a9a261e9d4d192087a, State: Running, Role: LEADER
I20260811 11:05:23.069103 29346 consensus_queue.cc:237] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } }
I20260811 11:05:23.069425 29216 raft_consensus.cc:2454] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f0dcdc0969c42a9a261e9d4d192087a in term 1.
I20260811 11:05:23.069453 29333 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: TxnStatusTablet state changed. Reason: New leader 5f0dcdc0969c42a9a261e9d4d192087a. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.069583 29333 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:23.069778 29396 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 11:05:23.069983 29396 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 11:05:23.069983 28446 catalog_manager.cc:5495] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2). New cstate: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:23.112757 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.109267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43932 (local address 127.25.227.2:38603)
0811 11:05:23.109355 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:23.109358 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:23.109368 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:23.109397 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:23.109398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:23.109412 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:23.109488 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:23.109692 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.110466 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.111752 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.112130 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.112224 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.112429 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.112481 (+ 52us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.112550 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:23.112612 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 11:05:23.112658 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 11:05:23.112756 29384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.108645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:38603 (local address 127.0.0.1:43932)
0811 11:05:23.108735 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:23.108759 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:23.108808 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:23.109542 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:23.109543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:23.109545 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:23.109621 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:23.109624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.110563 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.110565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:23.111659 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:23.111663 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.112239 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.112240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:23.112314 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.112332 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.112551 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.112559 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 11:05:23.112609 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:23.112664 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 11:05:23.113915 28729 raft_consensus.cc:1261] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Refusing update from remote peer 5f0dcdc0969c42a9a261e9d4d192087a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:23.113914 29216 raft_consensus.cc:1261] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Refusing update from remote peer 5f0dcdc0969c42a9a261e9d4d192087a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:23.114156 29333 consensus_queue.cc:1035] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:23.114240 29346 consensus_queue.cc:1035] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a [LEADER]: Connected to new peer: Peer: permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:23.115011 29327 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: TxnStatusTablet state changed. Reason: New leader 5f0dcdc0969c42a9a261e9d4d192087a. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.115021 29330 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: TxnStatusTablet state changed. Reason: New leader 5f0dcdc0969c42a9a261e9d4d192087a. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.115111 29327 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:23.115114 29330 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:23.115891 29333 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.115983 29333 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:23.116036 29333 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.116077 29333 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 5f0dcdc0969c42a9a261e9d4d192087a: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:23.116094 29327 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.116197 29327 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 4794d1b53b3e4a3cb1f32484cb716208: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:23.117304 29330 tablet_replica.cc:439] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 } } peers { permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 } } peers { permanent_uuid: "626ce44bbbdb45f4a4a5c82ff2041233" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 37439 } } }
I20260811 11:05:23.117401 29330 tablet_replica.cc:442] T 9e79466ae12244df90fb44aca6f60a80 P 626ce44bbbdb45f4a4a5c82ff2041233: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:23.123795 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.121255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.25.227.3:37439)
0811 11:05:23.121310 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:23.121313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:23.121322 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:23.121359 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:23.121360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:23.121381 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:23.121453 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:23.121614 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.122139 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.122940 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.123150 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.123228 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.123379 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.123493 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.123570 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:23.123621 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 11:05:23.123640 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 11:05:23.128759 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.126333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:38603 (local address 127.25.227.3:41409)
0811 11:05:23.126413 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:23.126425 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:23.126470 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:23.126591 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:23.126592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:23.126593 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:23.126651 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:23.126652 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.127268 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.127269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:23.127915 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:23.127917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.128303 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.128304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:23.128384 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.128405 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.128602 (+ 197us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.128604 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:23.128649 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 11:05:23.128693 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 11:05:23.128746 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.126401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:41409 (local address 127.25.227.2:38603)
0811 11:05:23.126456 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:23.126458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:23.126468 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:23.126522 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:23.126523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:23.126535 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:23.126588 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:23.126704 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.127144 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.128015 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.128222 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.128303 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.128495 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.128533 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.128590 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:23.128653 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:05:23.128673 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 11:05:23.131269 28729 raft_consensus.cc:1261] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Refusing update from remote peer 626ce44bbbdb45f4a4a5c82ff2041233: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:23.131356 28970 raft_consensus.cc:1261] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Refusing update from remote peer 626ce44bbbdb45f4a4a5c82ff2041233: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:23.131671 29330 consensus_queue.cc:1035] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f0dcdc0969c42a9a261e9d4d192087a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:23.131824 29368 consensus_queue.cc:1035] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4794d1b53b3e4a3cb1f32484cb716208" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:23.141145 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.138469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:39287 (local address 127.25.227.3:37439)
0811 11:05:23.138508 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:23.138510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:23.138535 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:05:23.138644 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:23.138644 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:23.138654 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:23.138697 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:23.138816 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.139257 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.140406 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.140709 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.140784 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.140955 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.140982 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.141020 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:23.141078 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 11:05:23.141095 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:05:23.141227 29413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.138263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:37439 (local address 127.25.227.2:39287)
0811 11:05:23.138465 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:23.138477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:23.138531 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:23.138703 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:23.138704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:23.138706 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:23.138757 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:23.138759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.139337 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.139339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:23.140326 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:23.140329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.140790 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.140791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:23.140851 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.140868 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:23.141024 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:23.141025 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 11:05:23.141076 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:05:23.141120 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":111,"threads_started":1}
I20260811 11:05:23.150691 28446 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:23.150810 28446 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:23.151437 28446 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73080f0916dc42d9b0bdf9d52518c330: Sending DeleteTablet for 3 replicas of tablet 65bbacf82b5049ad926e3de2afe7a735
I20260811 11:05:23.151754 29177 tablet_service.cc:1514] Processing DeleteTablet for tablet 65bbacf82b5049ad926e3de2afe7a735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:23 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:52336
I20260811 11:05:23.151805 28690 tablet_service.cc:1514] Processing DeleteTablet for tablet 65bbacf82b5049ad926e3de2afe7a735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:23 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39384
I20260811 11:05:23.151863 29357 tablet_replica.cc:330] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: stopping tablet replica
I20260811 11:05:23.151908 29359 tablet_replica.cc:330] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: stopping tablet replica
I20260811 11:05:23.151929 29357 raft_consensus.cc:2229] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:23.151957 29359 raft_consensus.cc:2229] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:23.151993 29359 raft_consensus.cc:2258] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:23.152009 29357 raft_consensus.cc:2258] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:23.152966 28941 tablet_service.cc:1514] Processing DeleteTablet for tablet 65bbacf82b5049ad926e3de2afe7a735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:23 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:43908
I20260811 11:05:23.153057 29360 tablet_replica.cc:330] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: stopping tablet replica
I20260811 11:05:23.153101 29360 raft_consensus.cc:2229] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:23.153144 29360 raft_consensus.cc:2258] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:23.153394 29359 ts_tablet_manager.cc:1905] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:23.153517 29360 ts_tablet_manager.cc:1905] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:23.155125 29360 ts_tablet_manager.cc:1918] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:23.155126 29359 ts_tablet_manager.cc:1918] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:23.155196 29360 log.cc:1196] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/65bbacf82b5049ad926e3de2afe7a735
I20260811 11:05:23.155196 29359 log.cc:1196] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/65bbacf82b5049ad926e3de2afe7a735
I20260811 11:05:23.155428 29359 ts_tablet_manager.cc:1939] T 65bbacf82b5049ad926e3de2afe7a735 P 4794d1b53b3e4a3cb1f32484cb716208: Deleting consensus metadata
I20260811 11:05:23.155428 29360 ts_tablet_manager.cc:1939] T 65bbacf82b5049ad926e3de2afe7a735 P 5f0dcdc0969c42a9a261e9d4d192087a: Deleting consensus metadata
I20260811 11:05:23.155738 29357 ts_tablet_manager.cc:1905] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:23.155848 28425 catalog_manager.cc:4841] TS 5f0dcdc0969c42a9a261e9d4d192087a (127.25.227.2:38603): tablet 65bbacf82b5049ad926e3de2afe7a735 (table test-table [id=8e3aaa5d07d844d39dd4b13b79db52a8]) successfully deleted
I20260811 11:05:23.157776 29357 ts_tablet_manager.cc:1918] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:23.157845 29357 log.cc:1196] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/65bbacf82b5049ad926e3de2afe7a735
I20260811 11:05:23.158071 29357 ts_tablet_manager.cc:1939] T 65bbacf82b5049ad926e3de2afe7a735 P 626ce44bbbdb45f4a4a5c82ff2041233: Deleting consensus metadata
I20260811 11:05:23.158383 28420 catalog_manager.cc:4841] TS 626ce44bbbdb45f4a4a5c82ff2041233 (127.25.227.3:37439): tablet 65bbacf82b5049ad926e3de2afe7a735 (table test-table [id=8e3aaa5d07d844d39dd4b13b79db52a8]) successfully deleted
I20260811 11:05:23.158787 28421 catalog_manager.cc:4841] TS 4794d1b53b3e4a3cb1f32484cb716208 (127.25.227.1:40957): tablet 65bbacf82b5049ad926e3de2afe7a735 (table test-table [id=8e3aaa5d07d844d39dd4b13b79db52a8]) successfully deleted
Aug 11 11:05:23 dist-test-slave-z8x9 krb5kdc[28360](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446322, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:23.167449 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.152980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39392 (local address 127.25.227.1:40957)
0811 11:05:23.153024 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:23.153026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:23.155808 (+ 2782us) server_negotiation.cc:407] Connection header received
0811 11:05:23.155929 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:23.155930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:23.155941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:23.155973 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:23.157051 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.157899 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.159242 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.159524 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.159609 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.163466 (+ 3857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:23.163477 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:23.163477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:23.163486 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:23.165896 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:23.166341 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:23.166345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:23.166345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:23.166427 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:23.166669 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:23.166670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:23.166670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:23.166854 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:23.166976 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:23.167246 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 11:05:23.167348 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 11:05:23.168125 28800 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39392
I20260811 11:05:23.177103 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:23.169200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58612 (local address 127.25.227.62:40989)
0811 11:05:23.169249 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:23.169251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:23.169439 (+ 188us) server_negotiation.cc:407] Connection header received
0811 11:05:23.169488 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:23.169490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:23.169503 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:23.169565 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:23.170258 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.171006 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.172081 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:23.172364 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:23.172448 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:23.174007 (+ 1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:23.174009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:23.174009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:23.174017 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:23.175790 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:23.176213 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:23.176215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:23.176215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:23.176283 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:23.176521 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:23.176522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:23.176522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:23.176669 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:23.176779 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:23.176900 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 11:05:23.176999 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 11:05:23.177619 28446 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58612
I20260811 11:05:23.178424 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28575
I20260811 11:05:23.193010 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28829
I20260811 11:05:23.205729 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29079
I20260811 11:05:23.221094 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28385
2026-08-11T11:05:23Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2686 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:23 dist-test-slave-z8x9 krb5kdc[29436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:23 dist-test-slave-z8x9 krb5kdc[29436](info): set up 2 sockets
Aug 11 11:05:23 dist-test-slave-z8x9 krb5kdc[29436](info): commencing operation
krb5kdc: starting...
W20260811 11:05:24.523658 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:24 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:24.652105 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:37743
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:37743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:24.739112 29455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:24.739394 29455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:24.739436 29455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:24.741084 29455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:24.741174 29455 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 11:05:24.741219 29455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:24.741252 29455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:24.741283 29455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:24.741310 29455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:24.742903 29455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:37743
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:37743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:24.743212 29455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:24.743445 29455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:24.748564 29463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:24.748618 29470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:24.748571 29465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:24.748754 29455 server_base.cc:1034] running on GCE node
I20260811 11:05:24.749131 29455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:24.749507 29455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:24.750686 29455 hybrid_clock.cc:648] HybridClock initialized: now 1786446324750664 us; error 35 us; skew 500 ppm
Aug 11 11:05:24 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446324, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:24.753403 29455 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:24.753840 29455 webserver.cc:460] Webserver started at http://127.25.227.62:40625/ using document root <none> and password file <none>
I20260811 11:05:24.754076 29455 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:24.754148 29455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:24.754287 29455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:24.755388 29455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "d7090ae403e74109b68b0ae5a62c6fec"
format_stamp: "Formatted at 2026-08-11 11:05:24 on dist-test-slave-z8x9"
server_key: "9b1fd4256d624dcefe43c03931cd375a"
server_key_iv: "90183feb5900d5e313e8ec2105698d1f"
server_key_version: "encryptionkey@0"
I20260811 11:05:24.755841 29455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "d7090ae403e74109b68b0ae5a62c6fec"
format_stamp: "Formatted at 2026-08-11 11:05:24 on dist-test-slave-z8x9"
server_key: "9b1fd4256d624dcefe43c03931cd375a"
server_key_iv: "90183feb5900d5e313e8ec2105698d1f"
server_key_version: "encryptionkey@0"
I20260811 11:05:24.757355 29455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:24.758113 29478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:24.758287 29455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:24.758399 29455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "d7090ae403e74109b68b0ae5a62c6fec"
format_stamp: "Formatted at 2026-08-11 11:05:24 on dist-test-slave-z8x9"
server_key: "9b1fd4256d624dcefe43c03931cd375a"
server_key_iv: "90183feb5900d5e313e8ec2105698d1f"
server_key_version: "encryptionkey@0"
I20260811 11:05:24.758474 29455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:24.764763 29455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:24.766722 29455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:24.766889 29455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:24.771765 29455 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:37743
I20260811 11:05:24.771835 29570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:37743 every 8 connection(s)
I20260811 11:05:24.772151 29455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:24.772861 29572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:24.775179 29572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Bootstrap starting.
I20260811 11:05:24.775768 29572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:24.776024 29572 log.cc:824] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:24.776721 29572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: No bootstrap required, opened a new log
I20260811 11:05:24.777280 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29455
I20260811 11:05:24.777376 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:24.777549 26508 external_mini_cluster.cc:1428] Setting key b135fe0f474867e4d469ea131be71d70
I20260811 11:05:24.779726 29572 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7090ae403e74109b68b0ae5a62c6fec" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37743 } }
I20260811 11:05:24.779907 29572 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:24.779953 29572 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7090ae403e74109b68b0ae5a62c6fec, State: Initialized, Role: FOLLOWER
I20260811 11:05:24.780102 29572 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7090ae403e74109b68b0ae5a62c6fec" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37743 } }
I20260811 11:05:24.780187 29572 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:24.780211 29572 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:24.780288 29572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:24.780962 29572 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7090ae403e74109b68b0ae5a62c6fec" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37743 } }
I20260811 11:05:24.781075 29572 leader_election.cc:302] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7090ae403e74109b68b0ae5a62c6fec; no voters:
I20260811 11:05:24.781298 29572 leader_election.cc:288] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:24.781371 29581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:24.781554 29581 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [term 1 LEADER]: Becoming Leader. State: Replica: d7090ae403e74109b68b0ae5a62c6fec, State: Running, Role: LEADER
I20260811 11:05:24.781575 29572 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:24.781646 29581 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7090ae403e74109b68b0ae5a62c6fec" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37743 } }
I20260811 11:05:24.782006 29581 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7090ae403e74109b68b0ae5a62c6fec. Latest consensus state: current_term: 1 leader_uuid: "d7090ae403e74109b68b0ae5a62c6fec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7090ae403e74109b68b0ae5a62c6fec" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37743 } } }
I20260811 11:05:24.782104 29581 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:24.782015 29583 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7090ae403e74109b68b0ae5a62c6fec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7090ae403e74109b68b0ae5a62c6fec" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37743 } } }
I20260811 11:05:24.782251 29583 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:24.782423 29599 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:24.783020 29599 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:24.785547 29599 catalog_manager.cc:1347] Generated new cluster ID: 209fa12cf0644d798f68c52db485b6c2
I20260811 11:05:24.785625 29599 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:05:24 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:24.790668 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:24.778229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.25.227.62:37743)
0811 11:05:24.778445 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:24.778456 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:24.778491 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:05:24.779669 (+ 1178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:24.779681 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:24.779747 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:24.779909 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:24.780665 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.782153 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.783370 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.783867 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.783976 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:24.786938 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:24.786942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:24.786942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:24.786954 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:24.788885 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:24.789358 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:24.789361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:24.789362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:24.789477 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:24.789716 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:24.789717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:24.789717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:24.790050 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:24.790233 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:24.790313 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 11:05:24.790460 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":80,"threads_started":1}
I20260811 11:05:24.796017 29599 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:24.796512 29599 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:24.799845 29599 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Generated new TSK 0
I20260811 11:05:24.800050 29599 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:24.836179 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37743
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:24.929615 29621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:24.929936 29621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:24.929980 29621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:24.932277 29621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:24.932353 29621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:24.932401 29621 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 11:05:24.932428 29621 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:24.932466 29621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:24.935518 29621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:37743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:24.935859 29621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:24.936139 29621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:24.942431 29630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:24.942466 29631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:24.942677 29633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:24.942792 29621 server_base.cc:1034] running on GCE node
I20260811 11:05:24.943017 29621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:24.943349 29621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:24.944561 29621 hybrid_clock.cc:648] HybridClock initialized: now 1786446324944527 us; error 43 us; skew 500 ppm
Aug 11 11:05:24 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446324, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:24.951340 29621 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:24.952046 29621 webserver.cc:460] Webserver started at http://127.25.227.1:45295/ using document root <none> and password file <none>
I20260811 11:05:24.952355 29621 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:24.952428 29621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:24.952580 29621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:24.954144 29621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "1f0a48e4eea44c24b85b547fc9b083e8"
format_stamp: "Formatted at 2026-08-11 11:05:24 on dist-test-slave-z8x9"
server_key: "241b206c185e29c9b2a4f09c57ecea63"
server_key_iv: "40bf12c5b2fd6886349a4d733642c7ed"
server_key_version: "encryptionkey@0"
I20260811 11:05:24.954697 29621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "1f0a48e4eea44c24b85b547fc9b083e8"
format_stamp: "Formatted at 2026-08-11 11:05:24 on dist-test-slave-z8x9"
server_key: "241b206c185e29c9b2a4f09c57ecea63"
server_key_iv: "40bf12c5b2fd6886349a4d733642c7ed"
server_key_version: "encryptionkey@0"
I20260811 11:05:24.956393 29621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:24.957474 29646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:24.957695 29621 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:24.957808 29621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "1f0a48e4eea44c24b85b547fc9b083e8"
format_stamp: "Formatted at 2026-08-11 11:05:24 on dist-test-slave-z8x9"
server_key: "241b206c185e29c9b2a4f09c57ecea63"
server_key_iv: "40bf12c5b2fd6886349a4d733642c7ed"
server_key_version: "encryptionkey@0"
I20260811 11:05:24.957901 29621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:24.974906 29621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:24.976961 29621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:24.977130 29621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:24.977775 29621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:24.977819 29621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:24.977845 29621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:24.977895 29621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:24.985275 29621 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:34967
I20260811 11:05:24.985363 29860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:34967 every 8 connection(s)
I20260811 11:05:24.985662 29621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:05:24 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446324, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:24.988736 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:24.978438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:60261 (local address 127.25.227.62:37743)
0811 11:05:24.978512 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:24.978514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:24.978698 (+ 184us) server_negotiation.cc:407] Connection header received
0811 11:05:24.979210 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:24.979212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:24.979226 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:24.979312 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:24.980193 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.981057 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.982969 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.983329 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.983418 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:24.986296 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:24.986297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:24.986297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:24.986304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:24.987519 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:24.987907 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:24.987908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:24.987908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:24.987963 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:24.988182 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:24.988182 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:24.988183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:24.988297 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:24.988349 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:24.988582 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 11:05:24.988653 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:05:24.988903 29667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:24.978396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.25.227.1:60261)
0811 11:05:24.978563 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:24.978604 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:24.979113 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:24.979386 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:24.979389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:24.979780 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:24.980080 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:24.980087 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.981208 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.981209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:24.982847 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:24.982851 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.983421 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.983422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:24.983524 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:24.984254 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:24.984267 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:24.986193 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:24.987593 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:24.987600 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:24.987602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:24.987840 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:24.988022 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:24.988023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:24.988023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:24.988126 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:24.988353 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:24.988359 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:24.988489 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 11:05:24.988572 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 11:05:24.988696 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260811 11:05:24.989502 29866 heartbeater.cc:347] Connected to a master server at 127.25.227.62:37743
I20260811 11:05:24.989595 29866 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:24.989794 29866 heartbeater.cc:511] Master 127.25.227.62:37743 requested a full tablet report, sending...
I20260811 11:05:24.990355 29503 ts_manager.cc:194] Registered new tserver with Master: 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967)
I20260811 11:05:24.991268 29503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:60261
I20260811 11:05:24.995059 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29621
I20260811 11:05:24.995170 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:24.995388 26508 external_mini_cluster.cc:1428] Setting key 0e310a46327403e3988edab67dc6c049
I20260811 11:05:24.996042 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:24.990591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.25.227.1:56513)
0811 11:05:24.990770 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:24.990780 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:24.990835 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:24.990946 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:24.990947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:24.991102 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:24.991150 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:24.991152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.991955 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.991956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:24.992500 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:24.992502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.992826 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.992827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:24.992883 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:24.993369 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:24.993374 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:24.993663 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:24.994982 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:24.994983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:24.994984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:24.995230 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:24.995437 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:24.995438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:24.995438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:24.995513 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:24.995803 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:24.995803 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:24.995843 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 11:05:24.995900 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 11:05:24.995978 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":81,"threads_started":1}
I20260811 11:05:24.996094 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:24.990583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:56513 (local address 127.25.227.62:37743)
0811 11:05:24.990619 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:24.990622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:24.990844 (+ 222us) server_negotiation.cc:407] Connection header received
0811 11:05:24.990868 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:24.990869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:24.990879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:24.990936 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:24.991216 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.991857 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.992572 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:24.992759 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:24.992811 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:24.993739 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:24.993740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:24.993740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:24.993747 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:24.994902 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:24.995306 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:24.995307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:24.995307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:24.995367 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:24.995581 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:24.995582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:24.995583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:24.995738 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:24.995803 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:24.995941 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 11:05:24.996014 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:25.024647 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37743
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:25.108994 29887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:25.109303 29887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:25.109387 29887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:25.110560 29887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:25.110630 29887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:25.110664 29887 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 11:05:25.110693 29887 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:25.110730 29887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:25.112227 29887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:37743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:25.112522 29887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:25.112766 29887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:25.118000 29897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:25.117992 29906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:25.118005 29900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:25.118086 29887 server_base.cc:1034] running on GCE node
I20260811 11:05:25.118402 29887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:25.118676 29887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:25.119836 29887 hybrid_clock.cc:648] HybridClock initialized: now 1786446325119819 us; error 30 us; skew 500 ppm
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446325, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:25.122735 29887 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:25.123302 29887 webserver.cc:460] Webserver started at http://127.25.227.2:43251/ using document root <none> and password file <none>
I20260811 11:05:25.123561 29887 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:25.123632 29887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:25.123799 29887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:25.124876 29887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "cb622c919049468b8d6106c24f1c4ab2"
format_stamp: "Formatted at 2026-08-11 11:05:25 on dist-test-slave-z8x9"
server_key: "7efb142427893701e0a6864c25d6f0de"
server_key_iv: "48b11698c18cd9405331a6fe83de7275"
server_key_version: "encryptionkey@0"
I20260811 11:05:25.125316 29887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "cb622c919049468b8d6106c24f1c4ab2"
format_stamp: "Formatted at 2026-08-11 11:05:25 on dist-test-slave-z8x9"
server_key: "7efb142427893701e0a6864c25d6f0de"
server_key_iv: "48b11698c18cd9405331a6fe83de7275"
server_key_version: "encryptionkey@0"
I20260811 11:05:25.126813 29887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:25.127609 29918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:25.127795 29887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:25.127897 29887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "cb622c919049468b8d6106c24f1c4ab2"
format_stamp: "Formatted at 2026-08-11 11:05:25 on dist-test-slave-z8x9"
server_key: "7efb142427893701e0a6864c25d6f0de"
server_key_iv: "48b11698c18cd9405331a6fe83de7275"
server_key_version: "encryptionkey@0"
I20260811 11:05:25.127983 29887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:25.159125 29887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:25.161805 29887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:25.161976 29887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:25.162634 29887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:25.162690 29887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:25.162736 29887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:25.162787 29887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446325, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:25.170715 29887 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:35223
I20260811 11:05:25.170832 30109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:35223 every 8 connection(s)
I20260811 11:05:25.171193 29887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:25.173372 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.163090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:39701 (local address 127.25.227.62:37743)
0811 11:05:25.163163 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.163166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.163500 (+ 334us) server_negotiation.cc:407] Connection header received
0811 11:05:25.164012 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.164014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.164029 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.164107 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:25.164767 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.165425 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.166475 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.166687 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.166774 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.170171 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:25.170172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:25.170173 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:25.170181 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:25.172051 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.172466 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.172467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.172467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.172525 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.172747 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.172747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.172748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.172858 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:25.172910 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.173143 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.173305 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:05:25.173586 29939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.163094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.25.227.2:39701)
0811 11:05:25.163355 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.163398 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.163905 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.164201 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.164204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.164444 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:25.164657 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.164662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.165524 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.165525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.166365 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.166368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.166784 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.166786 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.166919 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.167483 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:25.167495 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:25.170077 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:25.172143 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.172150 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.172152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.172394 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.172585 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.172586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.172586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.172692 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.172914 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:25.172918 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:25.173034 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.173116 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.173337 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":114,"threads_started":1}
I20260811 11:05:25.174070 30110 heartbeater.cc:347] Connected to a master server at 127.25.227.62:37743
I20260811 11:05:25.174158 30110 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:25.174360 30110 heartbeater.cc:511] Master 127.25.227.62:37743 requested a full tablet report, sending...
I20260811 11:05:25.174734 29504 ts_manager.cc:194] Registered new tserver with Master: cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223)
I20260811 11:05:25.175268 29504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:39701
I20260811 11:05:25.180533 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.175240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:44475 (local address 127.25.227.62:37743)
0811 11:05:25.175277 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.175278 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.175375 (+ 97us) server_negotiation.cc:407] Connection header received
0811 11:05:25.175461 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.175462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.175473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.175528 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:25.175858 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.176325 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.177038 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.177331 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.177402 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.178208 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:25.178210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:25.178210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:25.178217 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:25.179349 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.179688 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.179689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.179690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.179745 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.179966 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.179967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.179967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.180113 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:25.180187 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.180378 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.180449 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 11:05:25.180543 30120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.175138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.25.227.2:44475)
0811 11:05:25.175290 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.175309 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.175404 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.175539 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.175540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.175698 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:25.175769 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.175770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.176420 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.176421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.176943 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.176944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.177415 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.177416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.177499 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.177853 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:25.177857 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:25.178118 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:25.179435 (+ 1317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.179436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.179436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.179613 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.179826 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.179827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.179828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.179894 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.180192 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:25.180193 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:25.180239 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.180329 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.180436 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260811 11:05:25.180536 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29887
I20260811 11:05:25.180641 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:25.180871 26508 external_mini_cluster.cc:1428] Setting key 54d13e0e0da31d2bca8cac660ffcdaf4
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:25.207291 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37743
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:25.292133 30127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:25.292362 30127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:25.292389 30127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:25.293643 30127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:25.293686 30127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:25.293707 30127 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 11:05:25.293720 30127 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:25.293764 30127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:25.295267 30127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:37743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:25.295516 30127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:25.295756 30127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:05:25.301074 30127 server_base.cc:1034] running on GCE node
W20260811 11:05:25.301008 30139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:25.301012 30141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:25.301049 30137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:25.301446 30127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:25.301720 30127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:25.302902 30127 hybrid_clock.cc:648] HybridClock initialized: now 1786446325302888 us; error 26 us; skew 500 ppm
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446325, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:25.305446 30127 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:25.305900 30127 webserver.cc:460] Webserver started at http://127.25.227.3:39333/ using document root <none> and password file <none>
I20260811 11:05:25.306130 30127 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:25.306201 30127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:25.306363 30127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:25.307435 30127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "1178d23007dc4bbe80b570f4c34327b3"
format_stamp: "Formatted at 2026-08-11 11:05:25 on dist-test-slave-z8x9"
server_key: "200627834817d71090734c41cd1b4a85"
server_key_iv: "5ef352ed8b5c19215368f5f809ddf64a"
server_key_version: "encryptionkey@0"
I20260811 11:05:25.307808 30127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "1178d23007dc4bbe80b570f4c34327b3"
format_stamp: "Formatted at 2026-08-11 11:05:25 on dist-test-slave-z8x9"
server_key: "200627834817d71090734c41cd1b4a85"
server_key_iv: "5ef352ed8b5c19215368f5f809ddf64a"
server_key_version: "encryptionkey@0"
I20260811 11:05:25.309306 30127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:25.310076 30154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:25.310251 30127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:25.310359 30127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "1178d23007dc4bbe80b570f4c34327b3"
format_stamp: "Formatted at 2026-08-11 11:05:25 on dist-test-slave-z8x9"
server_key: "200627834817d71090734c41cd1b4a85"
server_key_iv: "5ef352ed8b5c19215368f5f809ddf64a"
server_key_version: "encryptionkey@0"
I20260811 11:05:25.310434 30127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:25.327458 30127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:25.329562 30127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:25.329733 30127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:25.330286 30127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:25.330354 30127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:25.330404 30127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:25.330430 30127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446325, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:25.338310 30127 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:42829
I20260811 11:05:25.338408 30346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:42829 every 8 connection(s)
I20260811 11:05:25.338748 30127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:25.341378 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.330938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:56039 (local address 127.25.227.62:37743)
0811 11:05:25.331016 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.331020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.331198 (+ 178us) server_negotiation.cc:407] Connection header received
0811 11:05:25.331690 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.331692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.331707 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.331815 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:25.332848 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.333688 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.335365 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.335685 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.335761 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.338412 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:25.338414 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:25.338414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:25.338423 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:25.339914 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.340350 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.340351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.340352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.340415 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.340691 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.340692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.340692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.340819 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:25.340897 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.341198 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.341284 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:25.341568 30164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.330901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.25.227.3:56039)
0811 11:05:25.331067 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.331107 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.331594 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.331979 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.331985 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.332419 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:25.332730 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.332739 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.333795 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.333796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.335241 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.335244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.335787 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.335788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.335960 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.336548 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:25.336558 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:25.338305 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:25.340003 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.340011 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.340013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.340253 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.340486 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.340487 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.340487 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.340615 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.340888 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:25.340896 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:25.341039 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.341145 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.341336 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260811 11:05:25.342090 30351 heartbeater.cc:347] Connected to a master server at 127.25.227.62:37743
I20260811 11:05:25.342177 30351 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:25.342363 30351 heartbeater.cc:511] Master 127.25.227.62:37743 requested a full tablet report, sending...
I20260811 11:05:25.342612 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30127
I20260811 11:05:25.342700 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:25.342772 29503 ts_manager.cc:194] Registered new tserver with Master: 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:25.342892 26508 external_mini_cluster.cc:1428] Setting key 0a2c0da9623dfd3aba59666be73160af
I20260811 11:05:25.343254 29503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:56039
I20260811 11:05:25.343739 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:05:25.348950 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.343271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:42399 (local address 127.25.227.62:37743)
0811 11:05:25.343312 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.343314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.343428 (+ 114us) server_negotiation.cc:407] Connection header received
0811 11:05:25.343501 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.343502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.343511 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.343567 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:25.343952 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.344490 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.345142 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.345418 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.345501 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.346421 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:25.346423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:25.346423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:25.346432 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:25.347836 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.348244 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.348245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.348245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.348298 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.348487 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.348487 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.348488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.348587 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:25.348636 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.348832 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.348888 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:05:25.349107 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.343230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.25.227.3:42399)
0811 11:05:25.343377 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.343387 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.343442 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.343572 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.343573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.343796 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:25.343855 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.343857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.344586 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.344587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.345059 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.345060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.345501 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.345502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.345581 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.346045 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:25.346050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:25.346334 (+ 284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:25.347924 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.347925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.347926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.348170 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.348356 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.348357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.348357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.348430 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.348656 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:25.348657 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:25.348720 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.348816 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.348950 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:25.370229 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.363026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48636 (local address 127.25.227.62:37743)
0811 11:05:25.363094 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.363096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.363121 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:05:25.363201 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.363202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.363210 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.363320 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:25.363897 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.364406 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.365140 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.365422 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.365475 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.367697 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:25.367698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:25.367698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:25.367704 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:25.369135 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.369535 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.369535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.369536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.369589 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.369802 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.369803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.369803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.369914 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:25.369988 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.370083 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.370139 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:05:25.371923 29503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:25.373608 29503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:25.380395 30387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.376006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35223 (local address 127.0.0.1:33042)
0811 11:05:25.376405 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.376414 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.376451 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.376686 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.376689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.376709 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.376797 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.376799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.377924 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.377925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.379068 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.379071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.380070 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.380071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.380154 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.380168 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.380246 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.380308 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":19,"thread_start_us":90,"threads_started":1}
I20260811 11:05:25.380435 30392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.376329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33042 (local address 127.25.227.2:35223)
0811 11:05:25.376504 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.376510 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.376523 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:05:25.376567 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.376569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.376586 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.376668 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.376865 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.377846 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.379166 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.379909 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.379976 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.380033 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.380286 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.380328 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260811 11:05:25.380589 30383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.376006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:34967 (local address 127.0.0.1:39636)
0811 11:05:25.376182 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.376226 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.376293 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.376975 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.376976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.376978 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.377021 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.377022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.378374 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.378375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.379439 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.379442 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.380362 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.380363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.380441 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.380445 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.380480 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.380520 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":62,"threads_started":1}
I20260811 11:05:25.380862 30390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.376293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39636 (local address 127.25.227.1:34967)
0811 11:05:25.376815 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.376820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.376830 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:25.376868 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.376870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.376884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.376968 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.377109 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.378280 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.379533 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.380270 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.380691 (+ 421us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.380739 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.380763 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.380792 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":90,"threads_started":1}
I20260811 11:05:25.381557 29995 tablet_service.cc:1467] Processing CreateTablet for tablet 10614ae459e043b0abe0859542b48184 (DEFAULT_TABLE table=test-table [id=65657a8b2e864d68b67f76383a378094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:25.381702 29735 tablet_service.cc:1467] Processing CreateTablet for tablet 10614ae459e043b0abe0859542b48184 (DEFAULT_TABLE table=test-table [id=65657a8b2e864d68b67f76383a378094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:25.381979 29995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10614ae459e043b0abe0859542b48184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.382009 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.376034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:42829 (local address 127.0.0.1:44104)
0811 11:05:25.376503 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.376514 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.376571 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.377347 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.377349 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.377352 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.377397 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.377398 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.378560 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.378561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.379794 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.379798 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.381767 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.381769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.381838 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.381842 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.381898 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.381938 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":99,"threads_started":1}
I20260811 11:05:25.382114 29735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10614ae459e043b0abe0859542b48184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.382328 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.376291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44104 (local address 127.25.227.3:42829)
0811 11:05:25.377105 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.377110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.377132 (+ 22us) server_negotiation.cc:407] Connection header received
0811 11:05:25.377222 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.377225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.377243 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.377338 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.377463 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.378482 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.379913 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.381594 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.381663 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.381718 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.382190 (+ 472us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.382233 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772,"thread_start_us":102,"threads_started":1}
I20260811 11:05:25.382987 30233 tablet_service.cc:1467] Processing CreateTablet for tablet 10614ae459e043b0abe0859542b48184 (DEFAULT_TABLE table=test-table [id=65657a8b2e864d68b67f76383a378094]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:25.383324 30233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10614ae459e043b0abe0859542b48184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.385254 30395 tablet_bootstrap.cc:492] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Bootstrap starting.
I20260811 11:05:25.385846 30395 tablet_bootstrap.cc:654] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.386034 30396 tablet_bootstrap.cc:492] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Bootstrap starting.
I20260811 11:05:25.386222 30395 log.cc:824] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:25.386727 30396 tablet_bootstrap.cc:654] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.386997 30398 tablet_bootstrap.cc:492] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Bootstrap starting.
I20260811 11:05:25.387091 30396 log.cc:824] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:25.387455 30395 tablet_bootstrap.cc:492] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: No bootstrap required, opened a new log
I20260811 11:05:25.387531 30395 ts_tablet_manager.cc:1397] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:25.387941 30398 tablet_bootstrap.cc:654] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.388232 30398 log.cc:824] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:25.388973 30398 tablet_bootstrap.cc:492] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: No bootstrap required, opened a new log
I20260811 11:05:25.389027 30398 ts_tablet_manager.cc:1397] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:25.389204 30395 raft_consensus.cc:348] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.389371 30395 raft_consensus.cc:374] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.389418 30395 raft_consensus.cc:729] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.389541 30395 consensus_queue.cc:260] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.389849 30395 ts_tablet_manager.cc:1428] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:25.389957 30110 heartbeater.cc:503] Master 127.25.227.62:37743 was elected leader, sending a full tablet report...
I20260811 11:05:25.390614 30396 tablet_bootstrap.cc:492] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: No bootstrap required, opened a new log
I20260811 11:05:25.390683 30396 ts_tablet_manager.cc:1397] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 11:05:25.391041 30398 raft_consensus.cc:348] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.391206 30398 raft_consensus.cc:374] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.391240 30398 raft_consensus.cc:729] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1178d23007dc4bbe80b570f4c34327b3, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.391390 30398 consensus_queue.cc:260] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.391664 30398 ts_tablet_manager.cc:1428] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:05:25.391770 30351 heartbeater.cc:503] Master 127.25.227.62:37743 was elected leader, sending a full tablet report...
I20260811 11:05:25.392714 30396 raft_consensus.cc:348] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.392845 30396 raft_consensus.cc:374] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.392867 30396 raft_consensus.cc:729] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.392993 30396 consensus_queue.cc:260] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.393275 30396 ts_tablet_manager.cc:1428] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 11:05:25.393358 29866 heartbeater.cc:503] Master 127.25.227.62:37743 was elected leader, sending a full tablet report...
W20260811 11:05:25.421947 30112 tablet.cc:2369] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:05:25.486486 29868 tablet.cc:2369] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:05:25.589550 30353 tablet.cc:2369] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:25.593959 30405 raft_consensus.cc:482] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:25.594110 30405 raft_consensus.cc:504] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.594537 30405 leader_election.cc:288] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829), cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223)
I20260811 11:05:25.597760 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.594837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:51851 (local address 127.25.227.3:42829)
0811 11:05:25.594893 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.594895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.595011 (+ 116us) server_negotiation.cc:407] Connection header received
0811 11:05:25.595075 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.595077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.595089 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.595147 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.595311 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.596030 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.596931 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.597405 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.597487 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.597499 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.597643 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.597691 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 11:05:25.597761 30406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.594744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:42829 (local address 127.25.227.1:51851)
0811 11:05:25.594913 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.594927 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.595006 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.595162 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.595163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.595166 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.595232 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.595235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.596121 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.596122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.596840 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.596841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.597489 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.597490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.597564 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.597568 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.597613 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.597645 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":85,"threads_started":1}
I20260811 11:05:25.597826 30392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.594956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:60531 (local address 127.25.227.2:35223)
0811 11:05:25.595020 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.595022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.595037 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:05:25.595153 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.595154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.595163 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.595223 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.595408 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.595851 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.596963 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.597417 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.597500 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.597508 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.597707 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.597748 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:05:25.597886 30407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.594820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35223 (local address 127.25.227.1:60531)
0811 11:05:25.594954 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.594991 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.595056 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.595244 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.595245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.595248 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.595339 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.595341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.595962 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.595963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.596844 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.596847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.597522 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.597524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.597617 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.597630 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.597690 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.597730 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":4,"thread_start_us":66,"threads_started":1}
I20260811 11:05:25.598357 30041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10614ae459e043b0abe0859542b48184" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb622c919049468b8d6106c24f1c4ab2" is_pre_election: true
I20260811 11:05:25.598351 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10614ae459e043b0abe0859542b48184" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3" is_pre_election: true
I20260811 11:05:25.598510 30041 raft_consensus.cc:2454] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 0.
I20260811 11:05:25.598510 30270 raft_consensus.cc:2454] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 0.
I20260811 11:05:25.598742 29655 leader_election.cc:302] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1178d23007dc4bbe80b570f4c34327b3, 1f0a48e4eea44c24b85b547fc9b083e8; no voters:
I20260811 11:05:25.598867 30405 raft_consensus.cc:2781] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:25.598927 30405 raft_consensus.cc:482] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:25.598948 30405 raft_consensus.cc:3037] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.599627 30405 raft_consensus.cc:504] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.599781 30405 leader_election.cc:288] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 election: Requested vote from peers 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829), cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223)
I20260811 11:05:25.599931 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10614ae459e043b0abe0859542b48184" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3"
I20260811 11:05:25.599944 30041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10614ae459e043b0abe0859542b48184" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb622c919049468b8d6106c24f1c4ab2"
I20260811 11:05:25.600009 30270 raft_consensus.cc:3037] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.600056 30041 raft_consensus.cc:3037] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.600768 30270 raft_consensus.cc:2454] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 1.
I20260811 11:05:25.600941 29655 leader_election.cc:302] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1178d23007dc4bbe80b570f4c34327b3, 1f0a48e4eea44c24b85b547fc9b083e8; no voters:
I20260811 11:05:25.600978 30041 raft_consensus.cc:2454] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 1.
I20260811 11:05:25.601092 30405 raft_consensus.cc:2781] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:25.601276 30405 raft_consensus.cc:686] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 LEADER]: Becoming Leader. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Running, Role: LEADER
I20260811 11:05:25.601382 30405 consensus_queue.cc:237] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } }
I20260811 11:05:25.602174 29503 catalog_manager.cc:5495] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1). New cstate: current_term: 1 leader_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } health_report { overall_health: HEALTHY } } }
Aug 11 11:05:25 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446324, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:25.684546 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.677844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37743 (local address 127.0.0.1:48644)
0811 11:05:25.678015 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.678026 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.678089 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.678209 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.678210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.678515 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:25.678562 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.678564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.679172 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.679172 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.679683 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.679684 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.679990 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.679991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.680033 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.680521 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:25.680526 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:25.682027 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:25.683607 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.683614 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.683616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.683820 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.683990 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:25.683991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:25.683991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:25.684051 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:25.684266 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:25.684272 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:25.684314 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.684366 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.684456 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":104,"threads_started":1}
I20260811 11:05:25.684620 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.677890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48644 (local address 127.25.227.62:37743)
0811 11:05:25.677956 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.677959 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.678089 (+ 130us) server_negotiation.cc:407] Connection header received
0811 11:05:25.678130 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.678130 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.678140 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.678190 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:25.678625 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.679105 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.679750 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.679926 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.679977 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.682105 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:25.682106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:25.682106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:25.682113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:25.683539 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.683881 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.683882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.683882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.683934 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:25.684101 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:25.684101 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:25.684101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:25.684201 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:25.684260 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.684397 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.684503 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":39}
I20260811 11:05:25.686508 29503 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:48644:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 11:05:25.686740 29503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:25.688294 29995 tablet_service.cc:1467] Processing CreateTablet for tablet 73d02abbf9df4900b4482df9d6da0caf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2f9840b441043d7a59285bde932f0ff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:25.688324 29735 tablet_service.cc:1467] Processing CreateTablet for tablet 73d02abbf9df4900b4482df9d6da0caf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2f9840b441043d7a59285bde932f0ff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:25.688335 30233 tablet_service.cc:1467] Processing CreateTablet for tablet 73d02abbf9df4900b4482df9d6da0caf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b2f9840b441043d7a59285bde932f0ff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:25.688491 29735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73d02abbf9df4900b4482df9d6da0caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.688490 29995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73d02abbf9df4900b4482df9d6da0caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.688537 30233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73d02abbf9df4900b4482df9d6da0caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.689940 30398 tablet_bootstrap.cc:492] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: Bootstrap starting.
I20260811 11:05:25.690106 30395 tablet_bootstrap.cc:492] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: Bootstrap starting.
I20260811 11:05:25.690229 30396 tablet_bootstrap.cc:492] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: Bootstrap starting.
I20260811 11:05:25.690495 30398 tablet_bootstrap.cc:654] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.690523 30395 tablet_bootstrap.cc:654] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.690660 30396 tablet_bootstrap.cc:654] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.691195 30395 tablet_bootstrap.cc:492] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: No bootstrap required, opened a new log
I20260811 11:05:25.691243 30395 ts_tablet_manager.cc:1397] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:25.691399 30395 raft_consensus.cc:348] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.691485 30395 raft_consensus.cc:374] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.691512 30395 raft_consensus.cc:729] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.691565 30395 consensus_queue.cc:260] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.691686 30395 ts_tablet_manager.cc:1428] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:25.691736 30402 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.691787 30396 tablet_bootstrap.cc:492] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: No bootstrap required, opened a new log
I20260811 11:05:25.691833 30402 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.691856 30396 ts_tablet_manager.cc:1397] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 11:05:25.691998 30396 raft_consensus.cc:348] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.692075 30396 raft_consensus.cc:374] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.692101 30396 raft_consensus.cc:729] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.692113 30398 tablet_bootstrap.cc:492] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: No bootstrap required, opened a new log
I20260811 11:05:25.692157 30398 ts_tablet_manager.cc:1397] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:25.692152 30396 consensus_queue.cc:260] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.692297 30405 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.692317 30398 raft_consensus.cc:348] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.692370 30405 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.692390 30398 raft_consensus.cc:374] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.692415 30398 raft_consensus.cc:729] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1178d23007dc4bbe80b570f4c34327b3, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.692444 30396 ts_tablet_manager.cc:1428] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:25.692469 30398 consensus_queue.cc:260] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.692572 30398 ts_tablet_manager.cc:1428] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:25.692698 30404 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.692792 30404 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.698009 30402 raft_consensus.cc:482] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:25.698086 30402 raft_consensus.cc:504] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.698436 30402 leader_election.cc:288] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:25.702416 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.698729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:36175 (local address 127.25.227.3:42829)
0811 11:05:25.698788 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.698791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.698848 (+ 57us) server_negotiation.cc:407] Connection header received
0811 11:05:25.698906 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.698906 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.698916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.698983 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.699162 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.699892 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.701522 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.702033 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.702116 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.702127 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.702313 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.702348 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:05:25.702438 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.698671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:42829 (local address 127.25.227.2:36175)
0811 11:05:25.698784 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.698796 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.698853 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.698989 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.698989 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.698992 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.699089 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.699091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.699980 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.699981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.701418 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.701422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.702138 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.702140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.702212 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.702215 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.702304 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.702347 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":45,"thread_start_us":65,"threads_started":1}
I20260811 11:05:25.702543 30390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.698805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:47461 (local address 127.25.227.1:34967)
0811 11:05:25.698841 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.698843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.698852 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:25.698906 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.698906 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.698916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.698983 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:25.699163 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.699905 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.701752 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.702153 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.702240 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.702255 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.702420 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.702459 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 11:05:25.702764 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.698616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:34967 (local address 127.25.227.2:47461)
0811 11:05:25.698784 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.698796 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.698851 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.698988 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.698989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.698991 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:25.699090 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.699091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.699981 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.699982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.701686 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.701689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.702240 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.702241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.702330 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.702339 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.702412 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.702456 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":49,"thread_start_us":74,"threads_started":1}
I20260811 11:05:25.702800 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d02abbf9df4900b4482df9d6da0caf" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3" is_pre_election: true
I20260811 11:05:25.702884 30270 raft_consensus.cc:2454] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 0.
I20260811 11:05:25.703058 29930 leader_election.cc:302] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1178d23007dc4bbe80b570f4c34327b3, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:25.703106 29770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d02abbf9df4900b4482df9d6da0caf" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" is_pre_election: true
I20260811 11:05:25.703190 30402 raft_consensus.cc:2781] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:25.703233 30402 raft_consensus.cc:482] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:25.703259 30402 raft_consensus.cc:3037] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.703238 29770 raft_consensus.cc:2454] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 0.
I20260811 11:05:25.703917 30402 raft_consensus.cc:504] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.704057 30402 leader_election.cc:288] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 election: Requested vote from peers 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:25.704193 29770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d02abbf9df4900b4482df9d6da0caf" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0a48e4eea44c24b85b547fc9b083e8"
I20260811 11:05:25.704222 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d02abbf9df4900b4482df9d6da0caf" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3"
I20260811 11:05:25.704289 30270 raft_consensus.cc:3037] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.704303 29770 raft_consensus.cc:3037] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.704867 30270 raft_consensus.cc:2454] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 1.
I20260811 11:05:25.705029 29930 leader_election.cc:302] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1178d23007dc4bbe80b570f4c34327b3, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:25.705058 29770 raft_consensus.cc:2454] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 1.
I20260811 11:05:25.705262 30402 raft_consensus.cc:2781] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:25.705420 30402 raft_consensus.cc:686] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [term 1 LEADER]: Becoming Leader. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Running, Role: LEADER
I20260811 11:05:25.705521 30402 consensus_queue.cc:237] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.706030 30431 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: TxnStatusTablet state changed. Reason: New leader cb622c919049468b8d6106c24f1c4ab2. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.706174 30431 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:25.706439 30434 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 11:05:25.706571 30434 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 11:05:25.707337 29504 catalog_manager.cc:5495] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:25.716280 30392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.713466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33056 (local address 127.25.227.2:35223)
0811 11:05:25.713505 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.713507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.713580 (+ 73us) server_negotiation.cc:407] Connection header received
0811 11:05:25.713693 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.713693 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.713711 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.713777 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:25.713909 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.714455 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.715548 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.715728 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.715785 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.715988 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.716076 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.716132 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.716210 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.716225 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:05:25.716347 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.713430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35223 (local address 127.0.0.1:33056)
0811 11:05:25.713499 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.713512 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.713595 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.713793 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.713794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.713796 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:25.713847 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.713849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.714536 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.714537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.715461 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.715463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.715804 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.715805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.715877 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.715896 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.716142 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.716150 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.716209 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.716268 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 11:05:25.718119 30270 raft_consensus.cc:1261] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Refusing update from remote peer cb622c919049468b8d6106c24f1c4ab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:25.718165 29770 raft_consensus.cc:1261] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Refusing update from remote peer cb622c919049468b8d6106c24f1c4ab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:25.718528 30431 consensus_queue.cc:1035] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:25.718652 30402 consensus_queue.cc:1035] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:25.719920 30405 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: TxnStatusTablet state changed. Reason: New leader cb622c919049468b8d6106c24f1c4ab2. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.720017 30405 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.719970 30404 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: TxnStatusTablet state changed. Reason: New leader cb622c919049468b8d6106c24f1c4ab2. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.720064 30404 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.721107 30402 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.721222 30402 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:25.721338 30431 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.721421 30431 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P cb622c919049468b8d6106c24f1c4ab2: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:25.722023 30404 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.722035 30405 tablet_replica.cc:439] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } } }
I20260811 11:05:25.722101 30405 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P 1f0a48e4eea44c24b85b547fc9b083e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.722100 30404 tablet_replica.cc:442] T 73d02abbf9df4900b4482df9d6da0caf P 1178d23007dc4bbe80b570f4c34327b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:25.723129 30439 mvcc.cc:205] Tried to move back new op lower bound from 7317284150139133952 to 7317284150090493952. Current Snapshot: MvccSnapshot[applied={T|T < 7317284150139133952 or (T in {7317284150139133952})}]
I20260811 11:05:25.723289 30440 mvcc.cc:205] Tried to move back new op lower bound from 7317284150139133952 to 7317284150090493952. Current Snapshot: MvccSnapshot[applied={T|T < 7317284150139133952}]
I20260811 11:05:25.726495 30390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.723815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39638 (local address 127.25.227.1:34967)
0811 11:05:25.723856 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.723858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.723867 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:25.723902 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.723902 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.723919 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.723985 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:25.724174 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.724894 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.725661 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.725963 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.726035 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.726170 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.726290 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.726364 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.726388 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.726408 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:05:25.731990 30392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.729152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:59373 (local address 127.25.227.2:35223)
0811 11:05:25.729242 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.729244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.729387 (+ 143us) server_negotiation.cc:407] Connection header received
0811 11:05:25.729453 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.729454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.729462 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.729503 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:25.729631 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.730110 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.731234 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.731504 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.731557 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.731774 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.731799 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.731839 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.731926 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.731942 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:05:25.732062 30457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.729033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35223 (local address 127.25.227.1:59373)
0811 11:05:25.729312 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.729323 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.729396 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.729520 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.729521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.729522 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:25.729576 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.729577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.730204 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.730205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.731150 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.731153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.731585 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.731587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.731655 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.731671 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.731866 (+ 195us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.731868 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.731922 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.731967 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":191,"threads_started":1}
I20260811 11:05:25.734213 30041 raft_consensus.cc:1261] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Refusing update from remote peer 1f0a48e4eea44c24b85b547fc9b083e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:25.734441 30270 raft_consensus.cc:1261] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Refusing update from remote peer 1f0a48e4eea44c24b85b547fc9b083e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:25.734565 30409 consensus_queue.cc:1035] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:25.734884 30409 consensus_queue.cc:1035] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:25.743644 30390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.740656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:58005 (local address 127.25.227.1:34967)
0811 11:05:25.740793 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:25.740795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:25.740861 (+ 66us) server_negotiation.cc:407] Connection header received
0811 11:05:25.740926 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:25.740927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:25.740937 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:25.740991 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:25.741201 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.741659 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.742887 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.743179 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.743230 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.743460 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.743486 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.743523 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:25.743578 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 11:05:25.743595 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 11:05:25.743806 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:25.740631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:34967 (local address 127.25.227.2:58005)
0811 11:05:25.740803 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:25.740815 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:25.740875 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:25.741034 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:25.741035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:25.741037 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:25.741093 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.741095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.741727 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.741728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.742772 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:25.742775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:25.743260 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:25.743261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:25.743344 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:25.743360 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:25.743524 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:25.743526 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:25.743574 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 11:05:25.743616 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260811 11:05:25.746366 30438 mvcc.cc:205] Tried to move back new op lower bound from 7317284150205394944 to 7317284149664047104. Current Snapshot: MvccSnapshot[applied={T|T < 7317284150205394944}]
I20260811 11:05:25.753234 29503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:25.753346 29503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:25.754124 29503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Sending DeleteTablet for 3 replicas of tablet 10614ae459e043b0abe0859542b48184
I20260811 11:05:25.754495 29995 tablet_service.cc:1514] Processing DeleteTablet for tablet 10614ae459e043b0abe0859542b48184 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:25 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33042
I20260811 11:05:25.754772 30482 tablet_replica.cc:330] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: stopping tablet replica
I20260811 11:05:25.754884 30482 raft_consensus.cc:2229] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:25.754940 30482 raft_consensus.cc:2258] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:25.754897 30233 tablet_service.cc:1514] Processing DeleteTablet for tablet 10614ae459e043b0abe0859542b48184 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:25 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:44104
I20260811 11:05:25.755330 30482 ts_tablet_manager.cc:1905] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:25.755479 29503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48636:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:25.755626 29503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:25.757054 30482 ts_tablet_manager.cc:1918] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:25.757154 30482 log.cc:1196] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/10614ae459e043b0abe0859542b48184
I20260811 11:05:25.757331 30233 tablet_service.cc:1467] Processing CreateTablet for tablet a007736af6a746899b41f469b577bd84 (DEFAULT_TABLE table=test-table [id=4de8a7929fcf4f92a6405ea7785cf4f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:25.757474 30482 ts_tablet_manager.cc:1939] T 10614ae459e043b0abe0859542b48184 P cb622c919049468b8d6106c24f1c4ab2: Deleting consensus metadata
I20260811 11:05:25.757477 30233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a007736af6a746899b41f469b577bd84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.758833 30398 tablet_bootstrap.cc:492] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Bootstrap starting.
I20260811 11:05:25.759253 30398 tablet_bootstrap.cc:654] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.759899 29479 catalog_manager.cc:4841] TS cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223): tablet 10614ae459e043b0abe0859542b48184 (table test-table [id=65657a8b2e864d68b67f76383a378094]) successfully deleted
I20260811 11:05:25.760085 29995 tablet_service.cc:1467] Processing CreateTablet for tablet a007736af6a746899b41f469b577bd84 (DEFAULT_TABLE table=test-table [id=4de8a7929fcf4f92a6405ea7785cf4f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:25.760190 29995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a007736af6a746899b41f469b577bd84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.761569 30395 tablet_bootstrap.cc:492] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Bootstrap starting.
I20260811 11:05:25.762013 30395 tablet_bootstrap.cc:654] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.762985 30398 tablet_bootstrap.cc:492] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: No bootstrap required, opened a new log
I20260811 11:05:25.763037 30398 ts_tablet_manager.cc:1397] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:05:25.763177 30398 raft_consensus.cc:348] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.763244 30398 raft_consensus.cc:374] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.763265 30398 raft_consensus.cc:729] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1178d23007dc4bbe80b570f4c34327b3, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.763306 30398 consensus_queue.cc:260] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.763422 30398 ts_tablet_manager.cc:1428] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:25.764004 29735 tablet_service.cc:1514] Processing DeleteTablet for tablet 10614ae459e043b0abe0859542b48184 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:25 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39636
I20260811 11:05:25.764263 29734 tablet_service.cc:1467] Processing CreateTablet for tablet a007736af6a746899b41f469b577bd84 (DEFAULT_TABLE table=test-table [id=4de8a7929fcf4f92a6405ea7785cf4f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:25.764379 29734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a007736af6a746899b41f469b577bd84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:25.765846 30396 tablet_bootstrap.cc:492] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Bootstrap starting.
I20260811 11:05:25.766291 30396 tablet_bootstrap.cc:654] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:25.766986 30396 tablet_bootstrap.cc:492] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: No bootstrap required, opened a new log
I20260811 11:05:25.767040 30396 ts_tablet_manager.cc:1397] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:25.767217 30396 raft_consensus.cc:348] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.767299 30396 raft_consensus.cc:374] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.767328 30396 raft_consensus.cc:729] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.767369 30396 consensus_queue.cc:260] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.767465 30396 ts_tablet_manager.cc:1428] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:25.767645 30489 tablet_replica.cc:330] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: stopping tablet replica
I20260811 11:05:25.767683 30395 tablet_bootstrap.cc:492] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: No bootstrap required, opened a new log
I20260811 11:05:25.767728 30395 ts_tablet_manager.cc:1397] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 11:05:25.767757 30489 raft_consensus.cc:2229] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:25.767853 30489 raft_consensus.cc:2258] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:25.767891 30395 raft_consensus.cc:348] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.767961 30395 raft_consensus.cc:374] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:25.767984 30395 raft_consensus.cc:729] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Initialized, Role: FOLLOWER
I20260811 11:05:25.768000 30484 tablet_replica.cc:330] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: stopping tablet replica
I20260811 11:05:25.768033 30395 consensus_queue.cc:260] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.768105 30484 raft_consensus.cc:2229] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:25.768153 30484 raft_consensus.cc:2258] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:25.768141 30395 ts_tablet_manager.cc:1428] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:25.768740 30489 ts_tablet_manager.cc:1905] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:25.768929 30484 ts_tablet_manager.cc:1905] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:25.770568 30489 ts_tablet_manager.cc:1918] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:25.770659 30489 log.cc:1196] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/10614ae459e043b0abe0859542b48184
I20260811 11:05:25.770694 30484 ts_tablet_manager.cc:1918] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:25.770776 30484 log.cc:1196] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/10614ae459e043b0abe0859542b48184
I20260811 11:05:25.770963 30489 ts_tablet_manager.cc:1939] T 10614ae459e043b0abe0859542b48184 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting consensus metadata
I20260811 11:05:25.771425 30484 ts_tablet_manager.cc:1939] T 10614ae459e043b0abe0859542b48184 P 1178d23007dc4bbe80b570f4c34327b3: Deleting consensus metadata
I20260811 11:05:25.771442 29482 catalog_manager.cc:4841] TS 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967): tablet 10614ae459e043b0abe0859542b48184 (table test-table [id=65657a8b2e864d68b67f76383a378094]) successfully deleted
I20260811 11:05:25.771839 29483 catalog_manager.cc:4841] TS 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829): tablet 10614ae459e043b0abe0859542b48184 (table test-table [id=65657a8b2e864d68b67f76383a378094]) successfully deleted
I20260811 11:05:25.780768 30409 raft_consensus.cc:482] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:25.780844 30409 raft_consensus.cc:504] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.780999 30409 leader_election.cc:288] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:25.781261 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a007736af6a746899b41f469b577bd84" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3" is_pre_election: true
I20260811 11:05:25.781255 30041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a007736af6a746899b41f469b577bd84" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb622c919049468b8d6106c24f1c4ab2" is_pre_election: true
I20260811 11:05:25.781337 30041 raft_consensus.cc:2454] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 0.
I20260811 11:05:25.781337 30270 raft_consensus.cc:2454] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 0.
I20260811 11:05:25.781487 29649 leader_election.cc:302] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0a48e4eea44c24b85b547fc9b083e8, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:25.781713 30409 raft_consensus.cc:2781] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:25.781771 30409 raft_consensus.cc:482] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:25.781801 30409 raft_consensus.cc:3037] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.782616 30409 raft_consensus.cc:504] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.782763 30409 leader_election.cc:288] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 election: Requested vote from peers cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:25.782941 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a007736af6a746899b41f469b577bd84" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3"
I20260811 11:05:25.782974 30041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a007736af6a746899b41f469b577bd84" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb622c919049468b8d6106c24f1c4ab2"
I20260811 11:05:25.783015 30270 raft_consensus.cc:3037] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.783030 30041 raft_consensus.cc:3037] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:25.783735 30270 raft_consensus.cc:2454] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 1.
I20260811 11:05:25.783767 30041 raft_consensus.cc:2454] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 1.
I20260811 11:05:25.783897 29649 leader_election.cc:302] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0a48e4eea44c24b85b547fc9b083e8, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:25.783975 30409 raft_consensus.cc:2781] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:25.784011 30409 raft_consensus.cc:686] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 LEADER]: Becoming Leader. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Running, Role: LEADER
I20260811 11:05:25.784050 30409 consensus_queue.cc:237] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:25.784543 29503 catalog_manager.cc:5495] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1). New cstate: current_term: 1 leader_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:25.792122 30041 raft_consensus.cc:1261] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Refusing update from remote peer 1f0a48e4eea44c24b85b547fc9b083e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:25.792398 30270 raft_consensus.cc:1261] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Refusing update from remote peer 1f0a48e4eea44c24b85b547fc9b083e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:25.792433 30479 consensus_queue.cc:1035] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:25.792579 30479 consensus_queue.cc:1035] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:05:25.798595 30440 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 11:05:27.319216 29503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:27.319339 29503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48636:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:27.320218 29503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Sending DeleteTablet for 3 replicas of tablet a007736af6a746899b41f469b577bd84
I20260811 11:05:27.320508 30233 tablet_service.cc:1514] Processing DeleteTablet for tablet a007736af6a746899b41f469b577bd84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:27 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:44104
I20260811 11:05:27.320533 29995 tablet_service.cc:1514] Processing DeleteTablet for tablet a007736af6a746899b41f469b577bd84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:27 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33042
I20260811 11:05:27.320513 29734 tablet_service.cc:1514] Processing DeleteTablet for tablet a007736af6a746899b41f469b577bd84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:27 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39636
I20260811 11:05:27.320808 30538 tablet_replica.cc:330] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: stopping tablet replica
I20260811 11:05:27.320861 30538 raft_consensus.cc:2229] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:27.320887 30538 raft_consensus.cc:2258] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:27.321521 30533 tablet_replica.cc:330] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: stopping tablet replica
I20260811 11:05:27.321731 30538 ts_tablet_manager.cc:1905] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:27.323681 30538 ts_tablet_manager.cc:1918] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:05:27.323763 30538 log.cc:1196] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/a007736af6a746899b41f469b577bd84
I20260811 11:05:27.324002 30538 ts_tablet_manager.cc:1939] T a007736af6a746899b41f469b577bd84 P cb622c919049468b8d6106c24f1c4ab2: Deleting consensus metadata
I20260811 11:05:27.324297 30537 tablet_replica.cc:330] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: stopping tablet replica
I20260811 11:05:27.324360 29479 catalog_manager.cc:4841] TS cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223): tablet a007736af6a746899b41f469b577bd84 (table test-table [id=4de8a7929fcf4f92a6405ea7785cf4f7]) successfully deleted
I20260811 11:05:27.324389 30537 raft_consensus.cc:2229] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:27.324448 30537 raft_consensus.cc:2258] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:27.324677 30537 ts_tablet_manager.cc:1905] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:27.326076 30537 ts_tablet_manager.cc:1918] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:05:27.326165 30537 log.cc:1196] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/a007736af6a746899b41f469b577bd84
I20260811 11:05:27.326404 30537 ts_tablet_manager.cc:1939] T a007736af6a746899b41f469b577bd84 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting consensus metadata
I20260811 11:05:27.326730 29482 catalog_manager.cc:4841] TS 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967): tablet a007736af6a746899b41f469b577bd84 (table test-table [id=4de8a7929fcf4f92a6405ea7785cf4f7]) successfully deleted
I20260811 11:05:27.327284 30533 raft_consensus.cc:2229] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:27.327360 30533 raft_consensus.cc:2258] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:27.327603 30533 ts_tablet_manager.cc:1905] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:27.329276 30533 ts_tablet_manager.cc:1918] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:05:27.329331 30533 log.cc:1196] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/a007736af6a746899b41f469b577bd84
I20260811 11:05:27.329538 30533 ts_tablet_manager.cc:1939] T a007736af6a746899b41f469b577bd84 P 1178d23007dc4bbe80b570f4c34327b3: Deleting consensus metadata
I20260811 11:05:27.329859 29483 catalog_manager.cc:4841] TS 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829): tablet a007736af6a746899b41f469b577bd84 (table test-table [id=4de8a7929fcf4f92a6405ea7785cf4f7]) successfully deleted
Aug 11 11:05:27 dist-test-slave-z8x9 krb5kdc[29436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446327, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:05:27 dist-test-slave-z8x9 krb5kdc[29436](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446327, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:27.347301 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:27.339926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48656 (local address 127.25.227.62:37743)
0811 11:05:27.340091 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:27.340093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:27.340102 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:27.340159 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:27.340160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:27.340170 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:27.340225 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:27.340794 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.341454 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.342259 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.342458 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.342512 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:27.344733 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:27.344735 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:27.344735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:27.344741 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:27.346270 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:27.346599 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:27.346600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:27.346600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:27.346657 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:27.346834 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:27.346835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:27.346835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:27.346939 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:27.347016 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:27.347096 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 11:05:27.347204 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":105,"threads_started":1}
I20260811 11:05:27.348779 29503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:27.348922 29503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:27.350462 29995 tablet_service.cc:1467] Processing CreateTablet for tablet 887aaacc09bd4208a03396bc3d71b2d2 (DEFAULT_TABLE table=test-table [id=bf86e84bf01f48f6baad756d7c2443da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:27.350466 29734 tablet_service.cc:1467] Processing CreateTablet for tablet 887aaacc09bd4208a03396bc3d71b2d2 (DEFAULT_TABLE table=test-table [id=bf86e84bf01f48f6baad756d7c2443da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:27.350566 30233 tablet_service.cc:1467] Processing CreateTablet for tablet 887aaacc09bd4208a03396bc3d71b2d2 (DEFAULT_TABLE table=test-table [id=bf86e84bf01f48f6baad756d7c2443da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:27.350610 29734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887aaacc09bd4208a03396bc3d71b2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:27.350611 29995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887aaacc09bd4208a03396bc3d71b2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:27.350674 30233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 887aaacc09bd4208a03396bc3d71b2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:27.351720 30552 tablet_bootstrap.cc:492] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Bootstrap starting.
I20260811 11:05:27.352017 30553 tablet_bootstrap.cc:492] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Bootstrap starting.
I20260811 11:05:27.352543 30552 tablet_bootstrap.cc:654] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:27.352543 30553 tablet_bootstrap.cc:654] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:27.352905 30556 tablet_bootstrap.cc:492] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Bootstrap starting.
I20260811 11:05:27.353289 30552 tablet_bootstrap.cc:492] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: No bootstrap required, opened a new log
I20260811 11:05:27.353367 30552 ts_tablet_manager.cc:1397] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:27.353377 30556 tablet_bootstrap.cc:654] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:27.353488 30552 raft_consensus.cc:348] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.353569 30552 raft_consensus.cc:374] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:27.353596 30552 raft_consensus.cc:729] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Initialized, Role: FOLLOWER
I20260811 11:05:27.353655 30552 consensus_queue.cc:260] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.353792 30552 ts_tablet_manager.cc:1428] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:27.353935 30553 tablet_bootstrap.cc:492] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: No bootstrap required, opened a new log
I20260811 11:05:27.353983 30553 ts_tablet_manager.cc:1397] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:27.354126 30556 tablet_bootstrap.cc:492] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: No bootstrap required, opened a new log
I20260811 11:05:27.354187 30556 ts_tablet_manager.cc:1397] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:27.354151 30553 raft_consensus.cc:348] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.354242 30553 raft_consensus.cc:374] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:27.354266 30553 raft_consensus.cc:729] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1178d23007dc4bbe80b570f4c34327b3, State: Initialized, Role: FOLLOWER
I20260811 11:05:27.354348 30553 consensus_queue.cc:260] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.354389 30556 raft_consensus.cc:348] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.354489 30556 raft_consensus.cc:374] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:27.354532 30553 ts_tablet_manager.cc:1428] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:27.354559 30556 raft_consensus.cc:729] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Initialized, Role: FOLLOWER
I20260811 11:05:27.354633 30556 consensus_queue.cc:260] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.354744 30556 ts_tablet_manager.cc:1428] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:27.647607 30431 raft_consensus.cc:482] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:27.647735 30431 raft_consensus.cc:504] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.647967 30431 leader_election.cc:288] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:27.648311 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887aaacc09bd4208a03396bc3d71b2d2" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3" is_pre_election: true
I20260811 11:05:27.648257 29770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887aaacc09bd4208a03396bc3d71b2d2" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" is_pre_election: true
I20260811 11:05:27.648437 30270 raft_consensus.cc:2454] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 0.
I20260811 11:05:27.648461 29770 raft_consensus.cc:2454] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 0.
I20260811 11:05:27.648658 29930 leader_election.cc:302] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1178d23007dc4bbe80b570f4c34327b3, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:27.648798 30431 raft_consensus.cc:2781] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:27.648861 30431 raft_consensus.cc:482] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:27.648878 30431 raft_consensus.cc:3037] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:27.649616 30431 raft_consensus.cc:504] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.649763 30431 leader_election.cc:288] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 election: Requested vote from peers 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:27.649956 29770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887aaacc09bd4208a03396bc3d71b2d2" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0a48e4eea44c24b85b547fc9b083e8"
I20260811 11:05:27.649948 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "887aaacc09bd4208a03396bc3d71b2d2" candidate_uuid: "cb622c919049468b8d6106c24f1c4ab2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3"
I20260811 11:05:27.650032 30270 raft_consensus.cc:3037] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:27.650032 29770 raft_consensus.cc:3037] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:27.650786 30270 raft_consensus.cc:2454] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 1.
I20260811 11:05:27.650799 29770 raft_consensus.cc:2454] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb622c919049468b8d6106c24f1c4ab2 in term 1.
I20260811 11:05:27.651014 29924 leader_election.cc:302] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0a48e4eea44c24b85b547fc9b083e8, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:27.651146 30431 raft_consensus.cc:2781] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:27.651203 30431 raft_consensus.cc:686] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 1 LEADER]: Becoming Leader. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Running, Role: LEADER
I20260811 11:05:27.651260 30431 consensus_queue.cc:237] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.652001 29503 catalog_manager.cc:5495] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "cb622c919049468b8d6106c24f1c4ab2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:27.710188 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:27.707899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33060 (local address 127.25.227.2:35223)
0811 11:05:27.708070 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:27.708071 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:27.708079 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:27.708098 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:27.708099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:27.708109 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:27.708167 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:27.708330 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.708806 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.709577 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.709767 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.709824 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:27.709945 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:27.709972 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:27.710012 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:27.710061 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 11:05:27.710079 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260811 11:05:27.714784 30571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:27.712436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35223 (local address 127.25.227.2:59691)
0811 11:05:27.712623 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:27.712632 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:27.712708 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:27.712827 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:27.712828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:27.712829 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:27.712865 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:27.712866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.713434 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.713434 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:27.714137 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:27.714139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.714454 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.714454 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:27.714494 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:27.714498 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:27.714620 (+ 122us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:27.714621 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 11:05:27.714647 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 11:05:27.714696 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":114,"threads_started":1}
I20260811 11:05:27.714787 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:27.712526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:59691 (local address 127.25.227.2:35223)
0811 11:05:27.712586 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:27.712588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:27.712704 (+ 116us) server_negotiation.cc:407] Connection header received
0811 11:05:27.712766 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:27.712766 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:27.712776 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:27.712818 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:27.712900 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.713375 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.714210 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.714387 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.714437 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:27.714560 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:27.714584 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:27.714621 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:27.714655 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 11:05:27.714673 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:27.716704 29770 raft_consensus.cc:1261] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Refusing update from remote peer cb622c919049468b8d6106c24f1c4ab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:27.716704 30270 raft_consensus.cc:1261] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Refusing update from remote peer cb622c919049468b8d6106c24f1c4ab2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:27.716923 30431 consensus_queue.cc:1035] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:27.717028 30512 consensus_queue.cc:1035] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:27.727625 29504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:27.727764 29504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:27.728614 29504 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Sending DeleteTablet for 3 replicas of tablet 887aaacc09bd4208a03396bc3d71b2d2
I20260811 11:05:27.728904 29994 tablet_service.cc:1514] Processing DeleteTablet for tablet 887aaacc09bd4208a03396bc3d71b2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:27 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33042
I20260811 11:05:27.728943 29734 tablet_service.cc:1514] Processing DeleteTablet for tablet 887aaacc09bd4208a03396bc3d71b2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:27 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39636
I20260811 11:05:27.729012 30538 tablet_replica.cc:330] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: stopping tablet replica
I20260811 11:05:27.729050 30537 tablet_replica.cc:330] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: stopping tablet replica
I20260811 11:05:27.729069 30538 raft_consensus.cc:2229] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:27.729095 30537 raft_consensus.cc:2229] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:27.729130 30537 raft_consensus.cc:2258] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:27.729157 30538 raft_consensus.cc:2258] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:27.729519 30538 ts_tablet_manager.cc:1905] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:27.729521 30537 ts_tablet_manager.cc:1905] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:27.729619 30233 tablet_service.cc:1514] Processing DeleteTablet for tablet 887aaacc09bd4208a03396bc3d71b2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:27 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:44104
I20260811 11:05:27.729715 30533 tablet_replica.cc:330] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: stopping tablet replica
I20260811 11:05:27.729766 30533 raft_consensus.cc:2229] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:27.729810 30533 raft_consensus.cc:2258] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:27.729995 29504 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:27.730162 29504 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:27.731418 30538 ts_tablet_manager.cc:1918] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:27.731483 30538 log.cc:1196] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/887aaacc09bd4208a03396bc3d71b2d2
I20260811 11:05:27.731474 30537 ts_tablet_manager.cc:1918] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:27.731532 30537 log.cc:1196] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/887aaacc09bd4208a03396bc3d71b2d2
I20260811 11:05:27.731761 30538 ts_tablet_manager.cc:1939] T 887aaacc09bd4208a03396bc3d71b2d2 P cb622c919049468b8d6106c24f1c4ab2: Deleting consensus metadata
I20260811 11:05:27.731774 30537 ts_tablet_manager.cc:1939] T 887aaacc09bd4208a03396bc3d71b2d2 P 1f0a48e4eea44c24b85b547fc9b083e8: Deleting consensus metadata
I20260811 11:05:27.732144 29482 catalog_manager.cc:4841] TS 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967): tablet 887aaacc09bd4208a03396bc3d71b2d2 (table test-table [id=bf86e84bf01f48f6baad756d7c2443da]) successfully deleted
I20260811 11:05:27.732180 29479 catalog_manager.cc:4841] TS cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223): tablet 887aaacc09bd4208a03396bc3d71b2d2 (table test-table [id=bf86e84bf01f48f6baad756d7c2443da]) successfully deleted
I20260811 11:05:27.732309 29734 tablet_service.cc:1467] Processing CreateTablet for tablet d55ea59308714adda20e7ad457c17d96 (DEFAULT_TABLE table=test-table [id=ad0f6ab67aff40238ceab92196b1b1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:27.732417 29734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d55ea59308714adda20e7ad457c17d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:27.732400 29994 tablet_service.cc:1467] Processing CreateTablet for tablet d55ea59308714adda20e7ad457c17d96 (DEFAULT_TABLE table=test-table [id=ad0f6ab67aff40238ceab92196b1b1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:27.732512 29994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d55ea59308714adda20e7ad457c17d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:27.732497 30233 tablet_service.cc:1467] Processing CreateTablet for tablet d55ea59308714adda20e7ad457c17d96 (DEFAULT_TABLE table=test-table [id=ad0f6ab67aff40238ceab92196b1b1ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:27.732605 30233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d55ea59308714adda20e7ad457c17d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:27.733752 30556 tablet_bootstrap.cc:492] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8: Bootstrap starting.
I20260811 11:05:27.733951 30552 tablet_bootstrap.cc:492] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Bootstrap starting.
I20260811 11:05:27.734248 30556 tablet_bootstrap.cc:654] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:27.734366 30552 tablet_bootstrap.cc:654] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:27.734614 30553 tablet_bootstrap.cc:492] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Bootstrap starting.
I20260811 11:05:27.734848 30533 ts_tablet_manager.cc:1905] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:27.734913 30556 tablet_bootstrap.cc:492] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8: No bootstrap required, opened a new log
I20260811 11:05:27.734989 30556 ts_tablet_manager.cc:1397] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:27.735039 30553 tablet_bootstrap.cc:654] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:27.735113 30556 raft_consensus.cc:348] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.735194 30556 raft_consensus.cc:374] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:27.735215 30556 raft_consensus.cc:729] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Initialized, Role: FOLLOWER
I20260811 11:05:27.735268 30556 consensus_queue.cc:260] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.735365 30556 ts_tablet_manager.cc:1428] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:27.736228 30533 ts_tablet_manager.cc:1918] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:27.736291 30533 log.cc:1196] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/887aaacc09bd4208a03396bc3d71b2d2
I20260811 11:05:27.736516 30533 ts_tablet_manager.cc:1939] T 887aaacc09bd4208a03396bc3d71b2d2 P 1178d23007dc4bbe80b570f4c34327b3: Deleting consensus metadata
I20260811 11:05:27.736891 30553 tablet_bootstrap.cc:492] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: No bootstrap required, opened a new log
I20260811 11:05:27.736896 29483 catalog_manager.cc:4841] TS 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829): tablet 887aaacc09bd4208a03396bc3d71b2d2 (table test-table [id=bf86e84bf01f48f6baad756d7c2443da]) successfully deleted
I20260811 11:05:27.736953 30553 ts_tablet_manager.cc:1397] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:27.737102 30553 raft_consensus.cc:348] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.737214 30553 raft_consensus.cc:374] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:27.737238 30553 raft_consensus.cc:729] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1178d23007dc4bbe80b570f4c34327b3, State: Initialized, Role: FOLLOWER
I20260811 11:05:27.737233 30552 tablet_bootstrap.cc:492] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: No bootstrap required, opened a new log
I20260811 11:05:27.737304 30552 ts_tablet_manager.cc:1397] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 11:05:27.737286 30553 consensus_queue.cc:260] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.737387 30553 ts_tablet_manager.cc:1428] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:27.737411 30552 raft_consensus.cc:348] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.737481 30552 raft_consensus.cc:374] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:27.737525 30552 raft_consensus.cc:729] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb622c919049468b8d6106c24f1c4ab2, State: Initialized, Role: FOLLOWER
I20260811 11:05:27.737572 30552 consensus_queue.cc:260] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.737673 30552 ts_tablet_manager.cc:1428] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:27.809945 30523 raft_consensus.cc:482] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:27.810081 30523 raft_consensus.cc:504] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.810340 30523 leader_election.cc:288] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:27.810573 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d55ea59308714adda20e7ad457c17d96" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3" is_pre_election: true
I20260811 11:05:27.810570 30041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d55ea59308714adda20e7ad457c17d96" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb622c919049468b8d6106c24f1c4ab2" is_pre_election: true
I20260811 11:05:27.810684 30041 raft_consensus.cc:2454] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 0.
I20260811 11:05:27.810686 30270 raft_consensus.cc:2454] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 0.
I20260811 11:05:27.810856 29649 leader_election.cc:302] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0a48e4eea44c24b85b547fc9b083e8, cb622c919049468b8d6106c24f1c4ab2; no voters:
I20260811 11:05:27.810979 30523 raft_consensus.cc:2781] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:27.811020 30523 raft_consensus.cc:482] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:27.811039 30523 raft_consensus.cc:3037] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:27.811980 30523 raft_consensus.cc:504] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.812145 30523 leader_election.cc:288] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 election: Requested vote from peers cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223), 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829)
I20260811 11:05:27.812346 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d55ea59308714adda20e7ad457c17d96" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1178d23007dc4bbe80b570f4c34327b3"
I20260811 11:05:27.812355 30041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d55ea59308714adda20e7ad457c17d96" candidate_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb622c919049468b8d6106c24f1c4ab2"
I20260811 11:05:27.812433 30270 raft_consensus.cc:3037] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:27.812453 30041 raft_consensus.cc:3037] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:27.813285 30041 raft_consensus.cc:2454] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 1.
I20260811 11:05:27.813294 30270 raft_consensus.cc:2454] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0a48e4eea44c24b85b547fc9b083e8 in term 1.
I20260811 11:05:27.813513 29655 leader_election.cc:302] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1178d23007dc4bbe80b570f4c34327b3, 1f0a48e4eea44c24b85b547fc9b083e8; no voters:
I20260811 11:05:27.813609 30523 raft_consensus.cc:2781] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:27.813673 30523 raft_consensus.cc:686] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [term 1 LEADER]: Becoming Leader. State: Replica: 1f0a48e4eea44c24b85b547fc9b083e8, State: Running, Role: LEADER
I20260811 11:05:27.813745 30523 consensus_queue.cc:237] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } }
I20260811 11:05:27.814422 29504 catalog_manager.cc:5495] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1). New cstate: current_term: 1 leader_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f0a48e4eea44c24b85b547fc9b083e8" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 34967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:27.836241 30588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:27.833701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39640 (local address 127.25.227.1:34967)
0811 11:05:27.833901 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:27.833903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:27.833909 (+ 6us) server_negotiation.cc:407] Connection header received
0811 11:05:27.833937 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:27.833938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:27.833947 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:27.834019 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:27.834176 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.834675 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.835485 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:27.835707 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:27.835802 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:27.835953 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:27.835991 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:27.836062 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:27.836119 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 11:05:27.836141 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":131,"threads_started":1}
I20260811 11:05:27.838764 30270 raft_consensus.cc:1261] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Refusing update from remote peer 1f0a48e4eea44c24b85b547fc9b083e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:27.838790 30041 raft_consensus.cc:1261] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Refusing update from remote peer 1f0a48e4eea44c24b85b547fc9b083e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:27.839052 30523 consensus_queue.cc:1035] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1178d23007dc4bbe80b570f4c34327b3" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:27.839208 30409 consensus_queue.cc:1035] T d55ea59308714adda20e7ad457c17d96 P 1f0a48e4eea44c24b85b547fc9b083e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb622c919049468b8d6106c24f1c4ab2" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:05:27.843590 30507 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 11:05:29.362306 29502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:29.362447 29502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:29.363332 29502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7090ae403e74109b68b0ae5a62c6fec: Sending DeleteTablet for 3 replicas of tablet d55ea59308714adda20e7ad457c17d96
I20260811 11:05:29.363627 29994 tablet_service.cc:1514] Processing DeleteTablet for tablet d55ea59308714adda20e7ad457c17d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:29 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33042
I20260811 11:05:29.363634 29734 tablet_service.cc:1514] Processing DeleteTablet for tablet d55ea59308714adda20e7ad457c17d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:29 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39636
I20260811 11:05:29.363798 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29621
I20260811 11:05:29.363880 30233 tablet_service.cc:1514] Processing DeleteTablet for tablet d55ea59308714adda20e7ad457c17d96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:29 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:44104
I20260811 11:05:29.369880 30660 tablet_replica.cc:330] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: stopping tablet replica
I20260811 11:05:29.369957 30660 raft_consensus.cc:2229] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:29.370004 30660 raft_consensus.cc:2258] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:29.370110 30658 tablet_replica.cc:330] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: stopping tablet replica
I20260811 11:05:29.370163 30658 raft_consensus.cc:2229] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:29.370196 30658 raft_consensus.cc:2258] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:29.370429 30660 ts_tablet_manager.cc:1905] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:29.371508 30658 ts_tablet_manager.cc:1905] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:29.372325 30660 ts_tablet_manager.cc:1918] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:05:29.372400 30660 log.cc:1196] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/d55ea59308714adda20e7ad457c17d96
I20260811 11:05:29.372635 30660 ts_tablet_manager.cc:1939] T d55ea59308714adda20e7ad457c17d96 P 1178d23007dc4bbe80b570f4c34327b3: Deleting consensus metadata
I20260811 11:05:29.373005 29483 catalog_manager.cc:4841] TS 1178d23007dc4bbe80b570f4c34327b3 (127.25.227.3:42829): tablet d55ea59308714adda20e7ad457c17d96 (table test-table [id=ad0f6ab67aff40238ceab92196b1b1ae]) successfully deleted
I20260811 11:05:29.373340 30658 ts_tablet_manager.cc:1918] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 11:05:29.373430 30658 log.cc:1196] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/d55ea59308714adda20e7ad457c17d96
I20260811 11:05:29.373643 30658 ts_tablet_manager.cc:1939] T d55ea59308714adda20e7ad457c17d96 P cb622c919049468b8d6106c24f1c4ab2: Deleting consensus metadata
I20260811 11:05:29.373996 29479 catalog_manager.cc:4841] TS cb622c919049468b8d6106c24f1c4ab2 (127.25.227.2:35223): tablet d55ea59308714adda20e7ad457c17d96 (table test-table [id=ad0f6ab67aff40238ceab92196b1b1ae]) successfully deleted
W20260811 11:05:29.379483 29482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:34967 (error 108)
I20260811 11:05:29.379752 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29887
I20260811 11:05:29.391126 30663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:29.379885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:34967 (local address 127.0.0.1:39652)
0811 11:05:29.390980 (+ 11095us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:29.391066 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:34967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11054,"thread_start_us":63,"threads_started":1}
W20260811 11:05:29.391348 29482 catalog_manager.cc:4584] TS 1f0a48e4eea44c24b85b547fc9b083e8 (127.25.227.1:34967): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d55ea59308714adda20e7ad457c17d96: Network error: Client connection negotiation failed: client connection to 127.25.227.1:34967: connect: Connection refused (error 111)
I20260811 11:05:29.397059 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30127
I20260811 11:05:29.409106 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29455
2026-08-11T11:05:29Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6194 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:29 dist-test-slave-z8x9 krb5kdc[30667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:29 dist-test-slave-z8x9 krb5kdc[30667](info): set up 2 sockets
Aug 11 11:05:29 dist-test-slave-z8x9 krb5kdc[30667](info): commencing operation
krb5kdc: starting...
W20260811 11:05:31.177878 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.733s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:31 dist-test-slave-z8x9 krb5kdc[30667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:31.302333 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36759
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:31.385703 30686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:31.385967 30686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:31.386013 30686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:31.387208 30686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:31.387281 30686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:31.387306 30686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:31.387339 30686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:31.387367 30686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:31.388854 30686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:31.389132 30686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:31.389417 30686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:31.394483 30694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:31.394479 30701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:31.394486 30695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:31.394804 30686 server_base.cc:1034] running on GCE node
I20260811 11:05:31.395087 30686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:31.395407 30686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:31.396576 30686 hybrid_clock.cc:648] HybridClock initialized: now 1786446331396564 us; error 30 us; skew 500 ppm
Aug 11 11:05:31 dist-test-slave-z8x9 krb5kdc[30667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446331, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:31.402604 30686 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:31.403115 30686 webserver.cc:460] Webserver started at http://127.25.227.62:42771/ using document root <none> and password file <none>
I20260811 11:05:31.403312 30686 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:31.403357 30686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:31.403450 30686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:31.404585 30686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "4e172d5e17014defa4de83ca9d28349c"
format_stamp: "Formatted at 2026-08-11 11:05:31 on dist-test-slave-z8x9"
server_key: "bf0df767add2dd41a08754a0f6c5dd12"
server_key_iv: "89ca8cf06d879ba04223e7dffdff13e4"
server_key_version: "encryptionkey@0"
I20260811 11:05:31.404906 30686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "4e172d5e17014defa4de83ca9d28349c"
format_stamp: "Formatted at 2026-08-11 11:05:31 on dist-test-slave-z8x9"
server_key: "bf0df767add2dd41a08754a0f6c5dd12"
server_key_iv: "89ca8cf06d879ba04223e7dffdff13e4"
server_key_version: "encryptionkey@0"
I20260811 11:05:31.406430 30686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:05:31.407179 30713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:31.407356 30686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:31.407449 30686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "4e172d5e17014defa4de83ca9d28349c"
format_stamp: "Formatted at 2026-08-11 11:05:31 on dist-test-slave-z8x9"
server_key: "bf0df767add2dd41a08754a0f6c5dd12"
server_key_iv: "89ca8cf06d879ba04223e7dffdff13e4"
server_key_version: "encryptionkey@0"
I20260811 11:05:31.407505 30686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:31.442621 30686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:31.445257 30686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:31.445379 30686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:31.449414 30686 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:36759
I20260811 11:05:31.449471 30812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:36759 every 8 connection(s)
I20260811 11:05:31.449841 30686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:31.450753 30813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:31.453066 30813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c: Bootstrap starting.
I20260811 11:05:31.453794 30813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:31.454110 30813 log.cc:824] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:31.454833 30813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c: No bootstrap required, opened a new log
I20260811 11:05:31.456529 30813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e172d5e17014defa4de83ca9d28349c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36759 } }
I20260811 11:05:31.456697 30813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:31.456746 30813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e172d5e17014defa4de83ca9d28349c, State: Initialized, Role: FOLLOWER
I20260811 11:05:31.456949 30813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e172d5e17014defa4de83ca9d28349c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36759 } }
I20260811 11:05:31.457053 30813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:31.457098 30813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:31.457160 30813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:31.457727 30813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e172d5e17014defa4de83ca9d28349c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36759 } }
I20260811 11:05:31.457824 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30686
I20260811 11:05:31.457850 30813 leader_election.cc:302] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e172d5e17014defa4de83ca9d28349c; no voters:
I20260811 11:05:31.457957 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:31.458032 30813 leader_election.cc:288] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:31.458060 30818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:31.458143 26508 external_mini_cluster.cc:1428] Setting key 9527dd4d87f8f76b8aad7e8adceff738
I20260811 11:05:31.458204 30818 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [term 1 LEADER]: Becoming Leader. State: Replica: 4e172d5e17014defa4de83ca9d28349c, State: Running, Role: LEADER
I20260811 11:05:31.458313 30813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:31.458281 30818 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e172d5e17014defa4de83ca9d28349c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36759 } }
I20260811 11:05:31.458616 30818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e172d5e17014defa4de83ca9d28349c. Latest consensus state: current_term: 1 leader_uuid: "4e172d5e17014defa4de83ca9d28349c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e172d5e17014defa4de83ca9d28349c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36759 } } }
I20260811 11:05:31.458799 30818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:31.458873 30819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e172d5e17014defa4de83ca9d28349c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e172d5e17014defa4de83ca9d28349c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36759 } } }
I20260811 11:05:31.458976 30819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:31.459175 30841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:31.459789 30841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:31.461401 30841 catalog_manager.cc:1347] Generated new cluster ID: a83dfda9f423456c8cc7ea517873cb7b
I20260811 11:05:31.461488 30841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:05:31 dist-test-slave-z8x9 krb5kdc[30667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:31.467872 30841 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:31.468539 30841 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:31.469731 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:31.458793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48586 (local address 127.25.227.62:36759)
0811 11:05:31.459144 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:31.459155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:31.459190 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:05:31.459325 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:31.459332 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:31.459390 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:31.460242 (+ 852us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:31.460577 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:31.461906 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:31.462680 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:31.463103 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:31.463223 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:31.465575 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:31.465579 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:31.465579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:31.465592 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:31.468083 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:31.468467 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:31.468471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:31.468471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:31.468569 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:31.468821 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:31.468822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:31.468823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:31.469063 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:31.469277 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:31.469350 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 11:05:31.469504 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":105,"threads_started":1}
I20260811 11:05:31.477432 30841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e172d5e17014defa4de83ca9d28349c: Generated new TSK 0
I20260811 11:05:31.477595 30841 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:31.509526 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36759
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:31.605602 30867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:31.605829 30867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:31.605854 30867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:31.607050 30867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:31.607097 30867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:31.607125 30867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:31.608609 30867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:31.608850 30867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:31.609102 30867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:31.614535 30877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:31.614528 30878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:31.614779 30880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:31.614809 30867 server_base.cc:1034] running on GCE node
I20260811 11:05:31.615027 30867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:31.615316 30867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:31.616488 30867 hybrid_clock.cc:648] HybridClock initialized: now 1786446331616463 us; error 43 us; skew 500 ppm
Aug 11 11:05:31 dist-test-slave-z8x9 krb5kdc[30667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446331, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:31.619174 30867 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:31.619685 30867 webserver.cc:460] Webserver started at http://127.25.227.1:39971/ using document root <none> and password file <none>
I20260811 11:05:31.619920 30867 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:31.619989 30867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:31.620148 30867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:31.621421 30867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "2120509d1f954da1b4046c05750153fa"
format_stamp: "Formatted at 2026-08-11 11:05:31 on dist-test-slave-z8x9"
server_key: "4dcc0f231754c84a14515cbfce61a92e"
server_key_iv: "8c7e453c948941eba248f1a5d81dd338"
server_key_version: "encryptionkey@0"
I20260811 11:05:31.621847 30867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "2120509d1f954da1b4046c05750153fa"
format_stamp: "Formatted at 2026-08-11 11:05:31 on dist-test-slave-z8x9"
server_key: "4dcc0f231754c84a14515cbfce61a92e"
server_key_iv: "8c7e453c948941eba248f1a5d81dd338"
server_key_version: "encryptionkey@0"
I20260811 11:05:31.623540 30867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:05:31.624387 30892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:31.624605 30867 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:31.624717 30867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "2120509d1f954da1b4046c05750153fa"
format_stamp: "Formatted at 2026-08-11 11:05:31 on dist-test-slave-z8x9"
server_key: "4dcc0f231754c84a14515cbfce61a92e"
server_key_iv: "8c7e453c948941eba248f1a5d81dd338"
server_key_version: "encryptionkey@0"
I20260811 11:05:31.624790 30867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:31.649896 30867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:31.652547 30867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:31.652674 30867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:31.652894 30867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:31.653318 30867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:31.653360 30867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:31.653385 30867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:31.653440 30867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:31.660063 30867 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:44433
I20260811 11:05:31.660152 31093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:44433 every 8 connection(s)
I20260811 11:05:31.660507 30867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:31.665798 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30867
I20260811 11:05:31.665921 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:31.666103 26508 external_mini_cluster.cc:1428] Setting key 67e625093d7ee2603e7b7695e44b8304
Aug 11 11:05:31 dist-test-slave-z8x9 krb5kdc[30667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446331, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:31.670954 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:31.661328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:52341 (local address 127.25.227.62:36759)
0811 11:05:31.661403 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:31.661405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:31.661639 (+ 234us) server_negotiation.cc:407] Connection header received
0811 11:05:31.662176 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:31.662178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:31.662190 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:31.662235 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:31.663197 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:31.663727 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:31.664725 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:31.664960 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:31.665041 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:31.667584 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:31.667585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:31.667586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:31.667595 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:31.669410 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:31.669925 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:31.669926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:31.669926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:31.669984 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:31.670267 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:31.670268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:31.670268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:31.670408 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:31.670463 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:31.670806 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 11:05:31.670887 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:05:31.671270 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:31.661325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36759 (local address 127.25.227.1:52341)
0811 11:05:31.661518 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:31.661556 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:31.662071 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:31.662305 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:31.662311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:31.662895 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:31.663092 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:31.663097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:31.663830 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:31.663831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:31.664629 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:31.664632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:31.665051 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:31.665052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:31.665224 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:31.665778 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:31.665787 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:31.667466 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:31.669505 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:31.669513 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:31.669516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:31.669842 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:31.670047 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:31.670048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:31.670049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:31.670199 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:31.670475 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:31.670482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:31.670661 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 11:05:31.670784 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 11:05:31.670973 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260811 11:05:31.671854 31094 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36759
I20260811 11:05:31.671962 31094 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:31.672178 31094 heartbeater.cc:511] Master 127.25.227.62:36759 requested a full tablet report, sending...
I20260811 11:05:31.672818 30749 ts_manager.cc:194] Registered new tserver with Master: 2120509d1f954da1b4046c05750153fa (127.25.227.1:44433)
I20260811 11:05:31.673506 30749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:52341
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
W20260811 11:05:32.644873 26508 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.25.227.2: real 0.978s user 0.002s sys 0.003s
I20260811 11:05:32.645426 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36759
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:05:32.674679 31094 heartbeater.cc:503] Master 127.25.227.62:36759 was elected leader, sending a full tablet report...
W20260811 11:05:32.737784 31102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:32.738035 31102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:32.738075 31102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:32.739264 31102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:32.739336 31102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:32.739382 31102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:32.740890 31102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:32.741204 31102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:32.741464 31102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:32.746910 31108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:32.746954 31110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:32.746954 31114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:32.747891 31102 server_base.cc:1034] running on GCE node
I20260811 11:05:32.748112 31102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:32.748347 31102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:32.749519 31102 hybrid_clock.cc:648] HybridClock initialized: now 1786446332749502 us; error 49 us; skew 500 ppm
Aug 11 11:05:32 dist-test-slave-z8x9 krb5kdc[30667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446332, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:32.752134 31102 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:32.752619 31102 webserver.cc:460] Webserver started at http://127.25.227.2:44927/ using document root <none> and password file <none>
I20260811 11:05:32.752815 31102 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:32.752857 31102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:32.752949 31102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:32.754371 31102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "e24d246fec34445bad40bf80d21706a2"
format_stamp: "Formatted at 2026-08-11 11:05:32 on dist-test-slave-z8x9"
server_key: "4a0c7c70a3f1fbb979f3152fde670a0f"
server_key_iv: "ea72cc16f185f198102e65c9666d9c7b"
server_key_version: "encryptionkey@0"
I20260811 11:05:32.754837 31102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "e24d246fec34445bad40bf80d21706a2"
format_stamp: "Formatted at 2026-08-11 11:05:32 on dist-test-slave-z8x9"
server_key: "4a0c7c70a3f1fbb979f3152fde670a0f"
server_key_iv: "ea72cc16f185f198102e65c9666d9c7b"
server_key_version: "encryptionkey@0"
I20260811 11:05:32.756296 31102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:32.756990 31128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:32.757241 31102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:32.757359 31102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "e24d246fec34445bad40bf80d21706a2"
format_stamp: "Formatted at 2026-08-11 11:05:32 on dist-test-slave-z8x9"
server_key: "4a0c7c70a3f1fbb979f3152fde670a0f"
server_key_iv: "ea72cc16f185f198102e65c9666d9c7b"
server_key_version: "encryptionkey@0"
I20260811 11:05:32.757454 31102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:32.777695 31102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:32.780223 31102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:32.780396 31102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:32.780654 31102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:32.781006 31102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:32.781065 31102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:32.781112 31102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:32.781145 31102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:32.787283 31102 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:35107
I20260811 11:05:32.787328 31302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:35107 every 8 connection(s)
I20260811 11:05:32.787671 31102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:32.791818 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31102
I20260811 11:05:32.791934 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:32.792135 26508 external_mini_cluster.cc:1428] Setting key 6026565a89dbd19353d93f05f44d2025
Aug 11 11:05:32 dist-test-slave-z8x9 krb5kdc[30667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446332, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:32.797933 31306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:32.788450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:49439 (local address 127.25.227.62:36759)
0811 11:05:32.788611 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:32.788613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:32.788693 (+ 80us) server_negotiation.cc:407] Connection header received
0811 11:05:32.789259 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:32.789260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:32.789273 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:32.789320 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:32.790330 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:32.790860 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:32.791886 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:32.792238 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:32.792306 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:32.794757 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:32.794759 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:32.794759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:32.794767 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:32.796334 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:32.796765 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:32.796767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:32.796767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:32.796835 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:32.797100 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:32.797101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:32.797102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:32.797305 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:32.797392 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:32.797732 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 11:05:32.797831 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
I20260811 11:05:32.798115 31305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:32.788402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36759 (local address 127.25.227.2:49439)
0811 11:05:32.788585 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:32.788624 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:32.789115 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:32.789386 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:32.789389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:32.790016 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:32.790217 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:32.790222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:32.790954 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:32.790954 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:32.791782 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:32.791785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:32.792440 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:32.792441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:32.792600 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:32.793232 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:32.793271 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:32.794643 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:32.796437 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:32.796446 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:32.796449 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:32.796681 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:32.796912 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:32.796912 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:32.796913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:32.797029 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:32.797450 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:32.797457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:32.797591 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 11:05:32.797708 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 11:05:32.797871 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":73,"threads_started":1}
I20260811 11:05:32.798645 31303 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36759
I20260811 11:05:32.798761 31303 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:32.798945 31303 heartbeater.cc:511] Master 127.25.227.62:36759 requested a full tablet report, sending...
I20260811 11:05:32.799393 30749 ts_manager.cc:194] Registered new tserver with Master: e24d246fec34445bad40bf80d21706a2 (127.25.227.2:35107)
I20260811 11:05:32.799788 30749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:49439
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
W20260811 11:05:33.391733 26508 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.25.227.3: real 0.599s user 0.000s sys 0.004s
I20260811 11:05:33.392140 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36759
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:33.483006 31312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:33.483254 31312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:33.483294 31312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:33.484460 31312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:33.484529 31312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:33.484573 31312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:33.486078 31312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:33.486343 31312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:33.486572 31312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:33.491708 31321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:33.491835 31323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:33.491709 31327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:33.491863 31312 server_base.cc:1034] running on GCE node
I20260811 11:05:33.492336 31312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:33.492617 31312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:33.493791 31312 hybrid_clock.cc:648] HybridClock initialized: now 1786446333493776 us; error 28 us; skew 500 ppm
Aug 11 11:05:33 dist-test-slave-z8x9 krb5kdc[30667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446333, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:33.496905 31312 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:33.497418 31312 webserver.cc:460] Webserver started at http://127.25.227.3:35575/ using document root <none> and password file <none>
I20260811 11:05:33.497650 31312 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:33.497728 31312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:33.497892 31312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:33.498963 31312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "c08fcd833b7b4bc490d11aefde5f0e05"
format_stamp: "Formatted at 2026-08-11 11:05:33 on dist-test-slave-z8x9"
server_key: "2d2e68a496b5e6c862f9527f3f95aab6"
server_key_iv: "eb9bf6c2aef0f741a57a5f377cef9adf"
server_key_version: "encryptionkey@0"
I20260811 11:05:33.499346 31312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "c08fcd833b7b4bc490d11aefde5f0e05"
format_stamp: "Formatted at 2026-08-11 11:05:33 on dist-test-slave-z8x9"
server_key: "2d2e68a496b5e6c862f9527f3f95aab6"
server_key_iv: "eb9bf6c2aef0f741a57a5f377cef9adf"
server_key_version: "encryptionkey@0"
I20260811 11:05:33.500772 31312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:33.501642 31341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:33.501816 31312 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:05:33.501929 31312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "c08fcd833b7b4bc490d11aefde5f0e05"
format_stamp: "Formatted at 2026-08-11 11:05:33 on dist-test-slave-z8x9"
server_key: "2d2e68a496b5e6c862f9527f3f95aab6"
server_key_iv: "eb9bf6c2aef0f741a57a5f377cef9adf"
server_key_version: "encryptionkey@0"
I20260811 11:05:33.502004 31312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:33.509821 31312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:33.513397 31312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:33.513545 31312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:33.513780 31312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:33.514096 31312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:33.514151 31312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:33.514202 31312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:33.514230 31312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:33.520460 31312 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:34643
I20260811 11:05:33.520519 31539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:34643 every 8 connection(s)
I20260811 11:05:33.520831 31312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:05:33 dist-test-slave-z8x9 krb5kdc[30667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446333, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:33.528425 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31312
I20260811 11:05:33.528546 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:33.528787 26508 external_mini_cluster.cc:1428] Setting key 0704428ebc9fcce248d3785515bf809c
I20260811 11:05:33.531539 31542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:33.521648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:34839 (local address 127.25.227.62:36759)
0811 11:05:33.521789 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:33.521791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:33.521981 (+ 190us) server_negotiation.cc:407] Connection header received
0811 11:05:33.522489 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:33.522490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:33.522507 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:33.522569 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:33.523493 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:33.524016 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:33.525014 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:33.525316 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:33.525394 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:33.527569 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:33.527571 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:33.527572 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:33.527582 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:33.530055 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:33.530583 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:33.530584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:33.530585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:33.530652 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:33.530962 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:33.530963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:33.530963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:33.531074 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:33.531126 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:33.531383 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 11:05:33.531458 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260811 11:05:33.531672 31546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:33.521625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36759 (local address 127.25.227.3:34839)
0811 11:05:33.521877 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:33.521906 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:33.522379 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:33.522633 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:33.522637 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:33.523203 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:33.523388 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:33.523392 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:33.524113 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:33.524115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:33.524905 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:33.524907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:33.525401 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:33.525402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:33.525534 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:33.526063 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:33.526071 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:33.527464 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:33.530146 (+ 2682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:33.530154 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:33.530157 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:33.530504 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:33.530728 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:33.530729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:33.530729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:33.530890 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:33.531147 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:33.531153 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:33.531270 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 11:05:33.531354 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 11:05:33.531478 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":95,"threads_started":1}
I20260811 11:05:33.532181 31540 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36759
I20260811 11:05:33.532292 31540 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:33.532471 31540 heartbeater.cc:511] Master 127.25.227.62:36759 requested a full tablet report, sending...
I20260811 11:05:33.532881 30749 ts_manager.cc:194] Registered new tserver with Master: c08fcd833b7b4bc490d11aefde5f0e05 (127.25.227.3:34643)
I20260811 11:05:33.533327 30749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:34839
I20260811 11:05:33.540760 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 11:05:33.555209 31542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:33.554236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38662 (local address 127.25.227.62:36759)
0811 11:05:33.554303 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:33.554306 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:33.554386 (+ 80us) server_negotiation.cc:407] Connection header received
0811 11:05:33.554437 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:33.554438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:33.554455 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:33.554519 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:33.555103 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38662: BlockingRecv error: recv got EOF from 127.0.0.1:38662 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:05:33.556128 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30867
I20260811 11:05:33.573637 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31102
I20260811 11:05:33.583945 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31312
I20260811 11:05:33.606897 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30686
2026-08-11T11:05:33Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4192 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:33 dist-test-slave-z8x9 krb5kdc[31564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:33 dist-test-slave-z8x9 krb5kdc[31564](info): set up 2 sockets
Aug 11 11:05:33 dist-test-slave-z8x9 krb5kdc[31564](info): commencing operation
krb5kdc: starting...
W20260811 11:05:34.929827 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:35 dist-test-slave-z8x9 krb5kdc[31564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:35.072077 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42319
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:42319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:35.156265 31587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:35.156484 31587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:35.156508 31587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:35.157797 31587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:35.157845 31587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:35.157858 31587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:35.157871 31587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:35.157883 31587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:35.159384 31587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:42319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:35.159580 31587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:35.159763 31587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:35.164880 31593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:35.164871 31594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:35.164871 31596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:35.165084 31587 server_base.cc:1034] running on GCE node
I20260811 11:05:35.165405 31587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:35.165743 31587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:35.166898 31587 hybrid_clock.cc:648] HybridClock initialized: now 1786446335166874 us; error 36 us; skew 500 ppm
Aug 11 11:05:35 dist-test-slave-z8x9 krb5kdc[31564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446335, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:35.169559 31587 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:35.170069 31587 webserver.cc:460] Webserver started at http://127.25.227.62:40733/ using document root <none> and password file <none>
I20260811 11:05:35.170336 31587 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:35.170411 31587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:35.170569 31587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:35.171649 31587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "aab4862f3ecf430b98c7b8017e61c42a"
format_stamp: "Formatted at 2026-08-11 11:05:35 on dist-test-slave-z8x9"
server_key: "ee94994e89d72ed52ee1951321d8bd71"
server_key_iv: "dc50ffaa18f4c1afcd33d6243f49e373"
server_key_version: "encryptionkey@0"
I20260811 11:05:35.172034 31587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "aab4862f3ecf430b98c7b8017e61c42a"
format_stamp: "Formatted at 2026-08-11 11:05:35 on dist-test-slave-z8x9"
server_key: "ee94994e89d72ed52ee1951321d8bd71"
server_key_iv: "dc50ffaa18f4c1afcd33d6243f49e373"
server_key_version: "encryptionkey@0"
I20260811 11:05:35.173496 31587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:05:35.174327 31612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:35.174506 31587 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:35.174615 31587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "aab4862f3ecf430b98c7b8017e61c42a"
format_stamp: "Formatted at 2026-08-11 11:05:35 on dist-test-slave-z8x9"
server_key: "ee94994e89d72ed52ee1951321d8bd71"
server_key_iv: "dc50ffaa18f4c1afcd33d6243f49e373"
server_key_version: "encryptionkey@0"
I20260811 11:05:35.174707 31587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:35.188268 31587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:35.190546 31587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:35.190726 31587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:35.195151 31587 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:42319
I20260811 11:05:35.195184 31696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:42319 every 8 connection(s)
I20260811 11:05:35.195776 31587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:35.196552 31697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:35.197630 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31587
I20260811 11:05:35.197748 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:35.197903 26508 external_mini_cluster.cc:1428] Setting key c4beb364a3fd04ff04cbbf390bf2975b
I20260811 11:05:35.199450 31697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a: Bootstrap starting.
I20260811 11:05:35.200263 31697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:35.200587 31697 log.cc:824] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:35.201375 31697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a: No bootstrap required, opened a new log
I20260811 11:05:35.204181 31697 raft_consensus.cc:348] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab4862f3ecf430b98c7b8017e61c42a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42319 } }
I20260811 11:05:35.204396 31697 raft_consensus.cc:374] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:35.204445 31697 raft_consensus.cc:729] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab4862f3ecf430b98c7b8017e61c42a, State: Initialized, Role: FOLLOWER
I20260811 11:05:35.204588 31697 consensus_queue.cc:260] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab4862f3ecf430b98c7b8017e61c42a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42319 } }
I20260811 11:05:35.204696 31697 raft_consensus.cc:388] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:35.204762 31697 raft_consensus.cc:482] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:35.204828 31697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 0 FOLLOWER]: Advancing to term 1
Aug 11 11:05:35 dist-test-slave-z8x9 krb5kdc[31564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:35.205641 31697 raft_consensus.cc:504] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab4862f3ecf430b98c7b8017e61c42a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42319 } }
I20260811 11:05:35.205767 31697 leader_election.cc:302] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aab4862f3ecf430b98c7b8017e61c42a; no voters:
I20260811 11:05:35.205963 31697 leader_election.cc:288] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:35.206018 31705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:35.206228 31705 raft_consensus.cc:686] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [term 1 LEADER]: Becoming Leader. State: Replica: aab4862f3ecf430b98c7b8017e61c42a, State: Running, Role: LEADER
I20260811 11:05:35.206247 31697 sys_catalog.cc:564] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:35.206391 31705 consensus_queue.cc:237] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab4862f3ecf430b98c7b8017e61c42a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42319 } }
I20260811 11:05:35.207050 31706 sys_catalog.cc:455] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aab4862f3ecf430b98c7b8017e61c42a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab4862f3ecf430b98c7b8017e61c42a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42319 } } }
I20260811 11:05:35.207455 31706 sys_catalog.cc:458] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:35.206959 31707 sys_catalog.cc:455] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [sys.catalog]: SysCatalogTable state changed. Reason: New leader aab4862f3ecf430b98c7b8017e61c42a. Latest consensus state: current_term: 1 leader_uuid: "aab4862f3ecf430b98c7b8017e61c42a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab4862f3ecf430b98c7b8017e61c42a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42319 } } }
I20260811 11:05:35.207772 31707 sys_catalog.cc:458] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:35.208926 31721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:35.209645 31721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:35.210199 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:35.198440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60192 (local address 127.25.227.62:42319)
0811 11:05:35.198616 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:35.198624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:35.198652 (+ 28us) server_negotiation.cc:407] Connection header received
0811 11:05:35.199203 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:35.199209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:35.199254 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:35.199370 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:35.200235 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:35.201297 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:35.202348 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:35.202760 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:35.202840 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:35.206415 (+ 3575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:35.206419 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:35.206420 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:35.206432 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:35.208546 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:35.208982 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:35.208985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:35.208986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:35.209104 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:35.209346 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:35.209347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:35.209347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:35.209590 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:35.209781 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:35.209850 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 11:05:35.209990 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260811 11:05:35.211196 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:05:35.213395 31721 catalog_manager.cc:1347] Generated new cluster ID: 35a85ce5c3af4bd29587e7e198dc6e9c
I20260811 11:05:35.213469 31721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:35.219436 31721 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:35.220222 31721 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:35.225968 31721 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aab4862f3ecf430b98c7b8017e61c42a: Generated new TSK 0
I20260811 11:05:35.226179 31721 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:05:35.231539 31703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:35.227274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60202 (local address 127.25.227.62:42319)
0811 11:05:35.227342 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:35.227345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:35.227526 (+ 181us) server_negotiation.cc:407] Connection header received
0811 11:05:35.227586 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:35.227587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:35.227599 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:35.227666 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:35.228206 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:35.228704 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:35.229998 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:35.230219 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:35.230278 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:35.231048 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:35.231049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:35.231050 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:35.231247 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:35.231265 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:35.231271 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:35.231321 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:35.231421 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 11:05:35.231446 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:35.234259 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31587
2026-08-11T11:05:35Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1642 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:35 dist-test-slave-z8x9 krb5kdc[31747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:35 dist-test-slave-z8x9 krb5kdc[31747](info): set up 2 sockets
Aug 11 11:05:35 dist-test-slave-z8x9 krb5kdc[31747](info): commencing operation
krb5kdc: starting...
W20260811 11:05:36.560715 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:36 dist-test-slave-z8x9 krb5kdc[31747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:36.688267 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:39213
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:39213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:36.771160 31777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:36.771374 31777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:36.771396 31777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:36.772475 31777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:36.772512 31777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:36.772526 31777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:36.772538 31777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:36.772552 31777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:36.773985 31777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:39213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:39213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:36.774183 31777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:36.774359 31777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:36.779238 31787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:36.779233 31785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:36.779326 31783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:36.779456 31777 server_base.cc:1034] running on GCE node
I20260811 11:05:36.779865 31777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:36.780156 31777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:36.781288 31777 hybrid_clock.cc:648] HybridClock initialized: now 1786446336781276 us; error 29 us; skew 500 ppm
Aug 11 11:05:36 dist-test-slave-z8x9 krb5kdc[31747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446336, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:36.787878 31777 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:36.788321 31777 webserver.cc:460] Webserver started at http://127.25.227.62:43877/ using document root <none> and password file <none>
I20260811 11:05:36.788553 31777 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:36.788623 31777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:36.788786 31777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:36.789920 31777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "2a3412d311bd4fdd90d7252de7dad3e1"
format_stamp: "Formatted at 2026-08-11 11:05:36 on dist-test-slave-z8x9"
server_key: "64411d2418deed6170d646cc7feb6178"
server_key_iv: "5b7fe3b26ab8c3f1db792ac82ff06273"
server_key_version: "encryptionkey@0"
I20260811 11:05:36.790298 31777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "2a3412d311bd4fdd90d7252de7dad3e1"
format_stamp: "Formatted at 2026-08-11 11:05:36 on dist-test-slave-z8x9"
server_key: "64411d2418deed6170d646cc7feb6178"
server_key_iv: "5b7fe3b26ab8c3f1db792ac82ff06273"
server_key_version: "encryptionkey@0"
I20260811 11:05:36.791621 31777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:05:36.792397 31798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:36.792569 31777 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:36.792676 31777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "2a3412d311bd4fdd90d7252de7dad3e1"
format_stamp: "Formatted at 2026-08-11 11:05:36 on dist-test-slave-z8x9"
server_key: "64411d2418deed6170d646cc7feb6178"
server_key_iv: "5b7fe3b26ab8c3f1db792ac82ff06273"
server_key_version: "encryptionkey@0"
I20260811 11:05:36.792775 31777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:36.804325 31777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:36.806265 31777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:36.806432 31777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:36.810591 31777 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:39213
I20260811 11:05:36.810627 31899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:39213 every 8 connection(s)
I20260811 11:05:36.810976 31777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:36.812148 31902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:36.813382 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31777
I20260811 11:05:36.813490 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:36.813654 26508 external_mini_cluster.cc:1428] Setting key 4e6b370e32f4c74b5afc6ce655c14b52
I20260811 11:05:36.814829 31902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1: Bootstrap starting.
I20260811 11:05:36.815675 31902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:36.816011 31902 log.cc:824] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:36.816720 31902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1: No bootstrap required, opened a new log
I20260811 11:05:36.819237 31902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39213 } }
I20260811 11:05:36.819422 31902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:36.819464 31902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a3412d311bd4fdd90d7252de7dad3e1, State: Initialized, Role: FOLLOWER
I20260811 11:05:36.819607 31902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39213 } }
I20260811 11:05:36.819720 31902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:36.819768 31902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:36.819818 31902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:36.820429 31902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39213 } }
I20260811 11:05:36.820520 31902 leader_election.cc:302] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a3412d311bd4fdd90d7252de7dad3e1; no voters:
Aug 11 11:05:36 dist-test-slave-z8x9 krb5kdc[31747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:36.820753 31902 leader_election.cc:288] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:36.820770 31912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:36.820912 31912 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 2a3412d311bd4fdd90d7252de7dad3e1, State: Running, Role: LEADER
I20260811 11:05:36.821053 31902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:36.821069 31912 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39213 } }
I20260811 11:05:36.821552 31914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39213 } } }
I20260811 11:05:36.821671 31914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:36.821772 31913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a3412d311bd4fdd90d7252de7dad3e1. Latest consensus state: current_term: 1 leader_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3412d311bd4fdd90d7252de7dad3e1" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39213 } } }
I20260811 11:05:36.822151 31913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:36.822650 31925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:36.823225 31925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:36.824921 31925 catalog_manager.cc:1347] Generated new cluster ID: 585a9a2bc9fe47f487005c1545799281
I20260811 11:05:36.824925 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:36.814170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40170 (local address 127.25.227.62:39213)
0811 11:05:36.814375 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:36.814383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:36.814407 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:05:36.814801 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:36.814807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:36.814851 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:36.815009 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:36.815889 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:36.816865 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:36.817962 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:36.818377 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:36.818457 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:36.821168 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:36.821173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:36.821173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:36.821212 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:36.823310 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:36.823660 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:36.823663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:36.823663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:36.823759 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:36.823974 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:36.823975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:36.823975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:36.824274 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:36.824445 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:36.824568 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 11:05:36.824716 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
I20260811 11:05:36.824991 31925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:36.843597 31925 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:36.844132 31925 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:36.849082 31925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a3412d311bd4fdd90d7252de7dad3e1: Generated new TSK 0
I20260811 11:05:36.849321 31925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:36.880713 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39213
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:36.965616 31941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:36.965816 31941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:36.965840 31941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:36.966928 31941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:36.966964 31941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:36.966991 31941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:36.968379 31941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:36.968562 31941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:36.968740 31941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:36.974192 31951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:36.974159 31954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:36.974217 31941 server_base.cc:1034] running on GCE node
W20260811 11:05:36.974177 31952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:36.974591 31941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:36.974893 31941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:36.976034 31941 hybrid_clock.cc:648] HybridClock initialized: now 1786446336976021 us; error 29 us; skew 500 ppm
Aug 11 11:05:36 dist-test-slave-z8x9 krb5kdc[31747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446336, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:36.978628 31941 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:36.979084 31941 webserver.cc:460] Webserver started at http://127.25.227.1:34127/ using document root <none> and password file <none>
I20260811 11:05:36.979338 31941 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:36.979385 31941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:36.979521 31941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:36.980551 31941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "a73b1c2f583b47b1858f1eef1046ae1d"
format_stamp: "Formatted at 2026-08-11 11:05:36 on dist-test-slave-z8x9"
server_key: "59eaadbe2229067ec3becdfb4f361582"
server_key_iv: "7edc0737c5b579a338952cd2000d4787"
server_key_version: "encryptionkey@0"
I20260811 11:05:36.980914 31941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "a73b1c2f583b47b1858f1eef1046ae1d"
format_stamp: "Formatted at 2026-08-11 11:05:36 on dist-test-slave-z8x9"
server_key: "59eaadbe2229067ec3becdfb4f361582"
server_key_iv: "7edc0737c5b579a338952cd2000d4787"
server_key_version: "encryptionkey@0"
I20260811 11:05:36.982395 31941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:36.983157 31963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:36.983340 31941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:36.983448 31941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "a73b1c2f583b47b1858f1eef1046ae1d"
format_stamp: "Formatted at 2026-08-11 11:05:36 on dist-test-slave-z8x9"
server_key: "59eaadbe2229067ec3becdfb4f361582"
server_key_iv: "7edc0737c5b579a338952cd2000d4787"
server_key_version: "encryptionkey@0"
I20260811 11:05:36.983522 31941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:36.990552 31941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:36.992301 31941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:36.992460 31941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:36.992694 31941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:36.993000 31941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:36.993057 31941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:36.993098 31941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:36.993126 31941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:36.999454 31941 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:42215
I20260811 11:05:36.999500 32147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:42215 every 8 connection(s)
I20260811 11:05:36.999805 31941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446336, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:37.005821 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31941
I20260811 11:05:37.005905 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:37.006107 26508 external_mini_cluster.cc:1428] Setting key 73c0879408032c54e994e7d1651c3fa8
I20260811 11:05:37.008994 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.000473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:45257 (local address 127.25.227.62:39213)
0811 11:05:37.000515 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:37.000517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:37.000739 (+ 222us) server_negotiation.cc:407] Connection header received
0811 11:05:37.001224 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:37.001226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:37.001238 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:37.001296 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:37.002165 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.002664 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.003604 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.003829 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.003881 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.005998 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:37.006000 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:37.006001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:37.006010 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:37.007548 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.007982 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.007984 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.007984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.008050 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.008316 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.008317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.008317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.008438 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:37.008509 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:37.008793 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 11:05:37.008899 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 11:05:37.009152 32150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.000469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39213 (local address 127.25.227.1:45257)
0811 11:05:37.000623 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:37.000658 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:37.001109 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:37.001348 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:37.001351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:37.001905 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:37.002089 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:37.002094 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.002745 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.002745 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:37.003532 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:37.003535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.003905 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.003905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:37.004003 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.004440 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:37.004448 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:37.005895 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:37.007636 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:37.007644 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:37.007646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:37.007892 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:37.008125 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:37.008126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:37.008126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:37.008237 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:37.008514 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:37.008521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:37.008654 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 11:05:37.008762 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 11:05:37.008922 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":94,"threads_started":1}
I20260811 11:05:37.009650 32148 heartbeater.cc:347] Connected to a master server at 127.25.227.62:39213
I20260811 11:05:37.009778 32148 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:37.009975 32148 heartbeater.cc:511] Master 127.25.227.62:39213 requested a full tablet report, sending...
I20260811 11:05:37.010499 31840 ts_manager.cc:194] Registered new tserver with Master: a73b1c2f583b47b1858f1eef1046ae1d (127.25.227.1:42215)
I20260811 11:05:37.011106 31840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:45257
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:37.034031 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39213
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:37.117658 32153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:37.117878 32153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:37.117901 32153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:37.119071 32153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:37.119117 32153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:37.119143 32153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:37.120683 32153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:37.120954 32153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:37.121219 32153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:37.126385 32161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:37.126430 32162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:37.126430 32165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:37.126567 32153 server_base.cc:1034] running on GCE node
I20260811 11:05:37.126803 32153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:37.127003 32153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:37.128170 32153 hybrid_clock.cc:648] HybridClock initialized: now 1786446337128150 us; error 30 us; skew 500 ppm
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446337, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:37.130797 32153 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:37.131274 32153 webserver.cc:460] Webserver started at http://127.25.227.2:40871/ using document root <none> and password file <none>
I20260811 11:05:37.131517 32153 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:37.131587 32153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:37.131742 32153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:37.132783 32153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "d89ebb811f26421fb7f2e3b00035ccf6"
format_stamp: "Formatted at 2026-08-11 11:05:37 on dist-test-slave-z8x9"
server_key: "8abaa4fe4ef456b22aa374e6f206a858"
server_key_iv: "d631ac5127cb8b74193573097527845e"
server_key_version: "encryptionkey@0"
I20260811 11:05:37.133150 32153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "d89ebb811f26421fb7f2e3b00035ccf6"
format_stamp: "Formatted at 2026-08-11 11:05:37 on dist-test-slave-z8x9"
server_key: "8abaa4fe4ef456b22aa374e6f206a858"
server_key_iv: "d631ac5127cb8b74193573097527845e"
server_key_version: "encryptionkey@0"
I20260811 11:05:37.134557 32153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:37.135327 32177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:37.135514 32153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:37.135620 32153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "d89ebb811f26421fb7f2e3b00035ccf6"
format_stamp: "Formatted at 2026-08-11 11:05:37 on dist-test-slave-z8x9"
server_key: "8abaa4fe4ef456b22aa374e6f206a858"
server_key_iv: "d631ac5127cb8b74193573097527845e"
server_key_version: "encryptionkey@0"
I20260811 11:05:37.135718 32153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:37.156406 32153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:37.159031 32153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:37.159211 32153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:37.159467 32153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:37.159816 32153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:37.159873 32153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:37.159910 32153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:37.159957 32153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:37.165982 32153 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:39471
I20260811 11:05:37.166036 32360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:39471 every 8 connection(s)
I20260811 11:05:37.166366 32153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:37.169831 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32153
I20260811 11:05:37.169948 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:37.170135 26508 external_mini_cluster.cc:1428] Setting key a0908ed464de7c9800895eccd82c8272
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446337, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:37.176777 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.167140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:37433 (local address 127.25.227.62:39213)
0811 11:05:37.167215 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:37.167217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:37.167407 (+ 190us) server_negotiation.cc:407] Connection header received
0811 11:05:37.167894 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:37.167895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:37.167905 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:37.167972 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:37.168926 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.169645 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.171094 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.171312 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.171392 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.173650 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:37.173652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:37.173652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:37.173661 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:37.175145 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.175684 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.175685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.175686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.175771 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.176079 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.176080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.176080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.176201 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:37.176257 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:37.176627 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 11:05:37.176711 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:05:37.177086 32365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.167088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39213 (local address 127.25.227.2:37433)
0811 11:05:37.167270 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:37.167313 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:37.167805 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:37.168027 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:37.168030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:37.168621 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:37.168839 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:37.168844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.169763 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.169764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:37.171005 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:37.171008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.171400 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.171401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:37.171545 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.172106 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:37.172115 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:37.173550 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:37.175239 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:37.175248 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:37.175251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:37.175602 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:37.175855 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:37.175856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:37.175857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:37.176008 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:37.176280 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:37.176288 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:37.176464 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 11:05:37.176594 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 11:05:37.176791 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260811 11:05:37.177757 32361 heartbeater.cc:347] Connected to a master server at 127.25.227.62:39213
I20260811 11:05:37.177876 32361 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:37.178083 32361 heartbeater.cc:511] Master 127.25.227.62:39213 requested a full tablet report, sending...
I20260811 11:05:37.178498 31840 ts_manager.cc:194] Registered new tserver with Master: d89ebb811f26421fb7f2e3b00035ccf6 (127.25.227.2:39471)
I20260811 11:05:37.178881 31840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:37433
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:37.197914 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39213
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:37.281862 32371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:37.282071 32371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:37.282094 32371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:37.283250 32371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:37.283295 32371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:37.283322 32371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:37.284696 32371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:37.284895 32371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:37.285074 32371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:37.290220 32385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:37.290299 32382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:37.290254 32376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:37.290520 32371 server_base.cc:1034] running on GCE node
I20260811 11:05:37.290716 32371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:37.290974 32371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:37.292141 32371 hybrid_clock.cc:648] HybridClock initialized: now 1786446337292136 us; error 36 us; skew 500 ppm
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446337, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:37.294636 32371 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:37.295120 32371 webserver.cc:460] Webserver started at http://127.25.227.3:36061/ using document root <none> and password file <none>
I20260811 11:05:37.295383 32371 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:37.295455 32371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:37.295606 32371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:37.296766 32371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "21b45cb0a9bc48d0911ab1dff4d406ac"
format_stamp: "Formatted at 2026-08-11 11:05:37 on dist-test-slave-z8x9"
server_key: "11794e3e94bdd7f335743ee5b12b3cdb"
server_key_iv: "8ad814a5e049ab956bdb37da4885777e"
server_key_version: "encryptionkey@0"
I20260811 11:05:37.297248 32371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "21b45cb0a9bc48d0911ab1dff4d406ac"
format_stamp: "Formatted at 2026-08-11 11:05:37 on dist-test-slave-z8x9"
server_key: "11794e3e94bdd7f335743ee5b12b3cdb"
server_key_iv: "8ad814a5e049ab956bdb37da4885777e"
server_key_version: "encryptionkey@0"
I20260811 11:05:37.298655 32371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:37.299429 32394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:37.299600 32371 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:37.299703 32371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "21b45cb0a9bc48d0911ab1dff4d406ac"
format_stamp: "Formatted at 2026-08-11 11:05:37 on dist-test-slave-z8x9"
server_key: "11794e3e94bdd7f335743ee5b12b3cdb"
server_key_iv: "8ad814a5e049ab956bdb37da4885777e"
server_key_version: "encryptionkey@0"
I20260811 11:05:37.299793 32371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:37.332708 32371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:37.334895 32371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:37.335076 32371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:37.335342 32371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:37.335693 32371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:37.335752 32371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:37.335788 32371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:37.335819 32371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:37.342450 32371 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:45487
I20260811 11:05:37.342499 32602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:45487 every 8 connection(s)
I20260811 11:05:37.342836 32371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:37.343292 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32371
I20260811 11:05:37.343365 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:37.343619 26508 external_mini_cluster.cc:1428] Setting key 3b536414be97fdd91f5e14cf9b0116f1
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446337, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:37.352247 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.343628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:51817 (local address 127.25.227.62:39213)
0811 11:05:37.343704 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:37.343706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:37.344008 (+ 302us) server_negotiation.cc:407] Connection header received
0811 11:05:37.344660 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:37.344661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:37.344671 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:37.344709 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:37.345739 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.346231 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.347212 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.347405 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.347456 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.349622 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:37.349624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:37.349625 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:37.349633 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:37.351091 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.351450 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.351450 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.351451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.351503 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.351729 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.351730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.351730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.351831 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:37.351883 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:37.352117 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 11:05:37.352180 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:37.352420 32606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.343593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39213 (local address 127.25.227.3:51817)
0811 11:05:37.343865 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:37.343931 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:37.344571 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:37.344771 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:37.344775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:37.345448 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:37.345657 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:37.345662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.346325 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.346326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:37.347138 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:37.347141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.347477 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.347478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:37.347588 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.348105 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:37.348114 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:37.349535 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:37.351160 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:37.351165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:37.351167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:37.351386 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:37.351561 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:37.351562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:37.351562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:37.351674 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:37.351887 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:37.351891 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:37.352006 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 11:05:37.352087 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:05:37.352212 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":94,"threads_started":1}
I20260811 11:05:37.352965 32604 heartbeater.cc:347] Connected to a master server at 127.25.227.62:39213
I20260811 11:05:37.353083 32604 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:37.353302 32604 heartbeater.cc:511] Master 127.25.227.62:39213 requested a full tablet report, sending...
I20260811 11:05:37.353706 31840 ts_manager.cc:194] Registered new tserver with Master: 21b45cb0a9bc48d0911ab1dff4d406ac (127.25.227.3:45487)
I20260811 11:05:37.354085 31840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:51817
I20260811 11:05:37.355305 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446337, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[31747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446337, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:37.378886 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:37.371948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40186 (local address 127.25.227.62:39213)
0811 11:05:37.372016 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:37.372018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:37.372125 (+ 107us) server_negotiation.cc:407] Connection header received
0811 11:05:37.372170 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:37.372171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:37.372180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:37.372235 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:37.372821 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.373351 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.374037 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:37.374216 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:37.374264 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:37.376468 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:37.376470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:37.376470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:37.376476 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:37.377946 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.378240 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.378241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.378241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.378292 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:37.378452 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:37.378452 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:37.378453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:37.378593 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:37.378674 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:37.378751 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 11:05:37.378812 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 11:05:37.379135 31840 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40186
I20260811 11:05:37.379585 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31941
I20260811 11:05:37.402626 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32153
I20260811 11:05:37.431459 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32371
I20260811 11:05:37.442445 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31777
2026-08-11T11:05:37Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2189 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[32620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[32620](info): set up 2 sockets
Aug 11 11:05:37 dist-test-slave-z8x9 krb5kdc[32620](info): commencing operation
krb5kdc: starting...
W20260811 11:05:38.738034 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:38 dist-test-slave-z8x9 krb5kdc[32620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:38.860132 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36841
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:36841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:38.941963 32638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:38.942214 32638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:38.942262 32638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:38.943420 32638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:38.943495 32638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:38.943517 32638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:38.943538 32638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:38.943570 32638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:38.945098 32638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:36841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:38.945413 32638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:38.945648 32638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:38.950441 32645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:38.950469 32650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:38.950536 32646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:38.950645 32638 server_base.cc:1034] running on GCE node
I20260811 11:05:38.950966 32638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:38.951283 32638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:38.952432 32638 hybrid_clock.cc:648] HybridClock initialized: now 1786446338952412 us; error 37 us; skew 500 ppm
Aug 11 11:05:38 dist-test-slave-z8x9 krb5kdc[32620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446338, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:38.955055 32638 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:38.955500 32638 webserver.cc:460] Webserver started at http://127.25.227.62:39827/ using document root <none> and password file <none>
I20260811 11:05:38.955761 32638 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:38.955834 32638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:38.955989 32638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:38.957064 32638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "8e0be667b79246c7aa32de90fbc100ab"
format_stamp: "Formatted at 2026-08-11 11:05:38 on dist-test-slave-z8x9"
server_key: "e9632ae76469259a02b2d1c3f3517461"
server_key_iv: "46e236204677a222b0887971afc7f131"
server_key_version: "encryptionkey@0"
I20260811 11:05:38.957535 32638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "8e0be667b79246c7aa32de90fbc100ab"
format_stamp: "Formatted at 2026-08-11 11:05:38 on dist-test-slave-z8x9"
server_key: "e9632ae76469259a02b2d1c3f3517461"
server_key_iv: "46e236204677a222b0887971afc7f131"
server_key_version: "encryptionkey@0"
I20260811 11:05:38.958920 32638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:38.959681 32662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:38.959874 32638 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:38.959970 32638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "8e0be667b79246c7aa32de90fbc100ab"
format_stamp: "Formatted at 2026-08-11 11:05:38 on dist-test-slave-z8x9"
server_key: "e9632ae76469259a02b2d1c3f3517461"
server_key_iv: "46e236204677a222b0887971afc7f131"
server_key_version: "encryptionkey@0"
I20260811 11:05:38.960055 32638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:38.995028 32638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:38.997005 32638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:38.997220 32638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:39.001381 32638 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:36841
I20260811 11:05:39.001433 32750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:36841 every 8 connection(s)
I20260811 11:05:39.001991 32638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:39.002709 32751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:39.004952 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32638
I20260811 11:05:39.005015 32751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab: Bootstrap starting.
I20260811 11:05:39.005076 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:39.005326 26508 external_mini_cluster.cc:1428] Setting key c34900cd4e430fb02898fbe9d97b5e4b
I20260811 11:05:39.005913 32751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:39.006354 32751 log.cc:824] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:39.007164 32751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab: No bootstrap required, opened a new log
I20260811 11:05:39.009632 32751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0be667b79246c7aa32de90fbc100ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36841 } }
I20260811 11:05:39.009766 32751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:39.009790 32751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e0be667b79246c7aa32de90fbc100ab, State: Initialized, Role: FOLLOWER
I20260811 11:05:39.009934 32751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0be667b79246c7aa32de90fbc100ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36841 } }
I20260811 11:05:39.010012 32751 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:39.010047 32751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:39.010102 32751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:39.010793 32751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0be667b79246c7aa32de90fbc100ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36841 } }
I20260811 11:05:39.010906 32751 leader_election.cc:302] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e0be667b79246c7aa32de90fbc100ab; no voters:
I20260811 11:05:39.011056 32751 leader_election.cc:288] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:39.011240 32760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:39.011358 32751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:39.011372 32760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [term 1 LEADER]: Becoming Leader. State: Replica: 8e0be667b79246c7aa32de90fbc100ab, State: Running, Role: LEADER
I20260811 11:05:39.011605 32760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0be667b79246c7aa32de90fbc100ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36841 } }
I20260811 11:05:39.012027 32760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e0be667b79246c7aa32de90fbc100ab. Latest consensus state: current_term: 1 leader_uuid: "8e0be667b79246c7aa32de90fbc100ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0be667b79246c7aa32de90fbc100ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36841 } } }
I20260811 11:05:39.012039 32756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e0be667b79246c7aa32de90fbc100ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0be667b79246c7aa32de90fbc100ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36841 } } }
I20260811 11:05:39.012317 32756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:39.012221 32760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:39.012676 306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:39.013441 306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:39.015027 306 catalog_manager.cc:1347] Generated new cluster ID: fd8d56822cb14a9c8d5d1590a36f54a1
I20260811 11:05:39.015075 306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:39.023415 306 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:39.024080 306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:39.025090 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.005953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.25.227.62:36841)
0811 11:05:39.006176 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:39.006187 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:39.006224 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:05:39.006765 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:39.006773 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:39.006861 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:39.007024 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:39.007760 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.009159 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.010063 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.010664 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.010786 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.013838 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:39.013842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:39.013842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:39.013854 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:39.023280 (+ 9426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.023735 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.023739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.023739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.023874 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.024112 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.024113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.024113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.024392 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:39.024557 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:39.024678 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 11:05:39.024851 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":83,"threads_started":1}
I20260811 11:05:39.029018 306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e0be667b79246c7aa32de90fbc100ab: Generated new TSK 0
I20260811 11:05:39.029229 306 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:39.056396 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36841
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:39.140043 322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:39.140261 322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:39.140285 322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:39.141546 322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:39.141589 322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:39.141615 322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:39.143088 322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:39.143278 322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:39.143448 322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:39.148555 328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:39.148609 329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:39.148805 322 server_base.cc:1034] running on GCE node
W20260811 11:05:39.148557 332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:39.149137 322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:39.149430 322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:39.150578 322 hybrid_clock.cc:648] HybridClock initialized: now 1786446339150566 us; error 48 us; skew 500 ppm
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:39.153118 322 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:39.153553 322 webserver.cc:460] Webserver started at http://127.25.227.1:40741/ using document root <none> and password file <none>
I20260811 11:05:39.153743 322 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:39.153782 322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:39.153870 322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:39.154822 322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "315cdab90fe44f0a83d742aaa4a2f8f1"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "59c006450d5ccfd5a3b8b0629c9ed938"
server_key_iv: "46556adbab33670de93111e41f363e13"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.155122 322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "315cdab90fe44f0a83d742aaa4a2f8f1"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "59c006450d5ccfd5a3b8b0629c9ed938"
server_key_iv: "46556adbab33670de93111e41f363e13"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.156392 322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 11:05:39.157094 352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.157310 322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:05:39.157423 322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "315cdab90fe44f0a83d742aaa4a2f8f1"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "59c006450d5ccfd5a3b8b0629c9ed938"
server_key_iv: "46556adbab33670de93111e41f363e13"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.157500 322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:39.183003 322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:39.185000 322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:39.185204 322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:39.185469 322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:39.185814 322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:39.185878 322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.185922 322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:39.185967 322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.191919 322 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:42773
I20260811 11:05:39.191977 547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:42773 every 8 connection(s)
I20260811 11:05:39.192296 322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:39.200970 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.193027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:60971 (local address 127.25.227.62:36841)
0811 11:05:39.193119 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:39.193121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:39.193306 (+ 185us) server_negotiation.cc:407] Connection header received
0811 11:05:39.194219 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:39.194220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:39.194231 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:39.194299 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:39.194878 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.195381 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.196322 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.196510 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.196560 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.198602 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:39.198603 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:39.198603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:39.198610 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:39.199817 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.200180 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.200180 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.200181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.200233 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.200455 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.200456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.200456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.200556 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:39.200605 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:39.200834 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 11:05:39.200903 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 11:05:39.201119 553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.192972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36841 (local address 127.25.227.1:60971)
0811 11:05:39.193137 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:39.193195 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:39.194127 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:39.194353 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:39.194356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:39.194607 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:39.194799 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:39.194804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.195465 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.195466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:39.196238 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:39.196240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.196584 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.196585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:39.196684 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.197096 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:39.197104 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:39.198520 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:39.199886 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:39.199893 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:39.199895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:39.200115 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:39.200297 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:39.200298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:39.200298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:39.200399 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:39.200610 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:39.200615 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:39.200724 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 11:05:39.200807 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 11:05:39.200924 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":101,"threads_started":1}
I20260811 11:05:39.201709 548 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36841
I20260811 11:05:39.201834 548 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:39.201941 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 322
I20260811 11:05:39.202046 548 heartbeater.cc:511] Master 127.25.227.62:36841 requested a full tablet report, sending...
I20260811 11:05:39.202059 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:39.202280 26508 external_mini_cluster.cc:1428] Setting key 73ea2c6f2776e5ff89929a48b6b4f312
I20260811 11:05:39.202664 32698 ts_manager.cc:194] Registered new tserver with Master: 315cdab90fe44f0a83d742aaa4a2f8f1 (127.25.227.1:42773)
I20260811 11:05:39.203392 32698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:60971
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:39.227878 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36841
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:39.310266 556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:39.310529 556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:39.310570 556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:39.311882 556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:39.311944 556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:39.311991 556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:39.313645 556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:39.313915 556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:39.314141 556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:39.319234 572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:39.319365 556 server_base.cc:1034] running on GCE node
W20260811 11:05:39.319201 567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:39.319201 568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:39.319723 556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:39.319963 556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:39.321127 556 hybrid_clock.cc:648] HybridClock initialized: now 1786446339321121 us; error 36 us; skew 500 ppm
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:39.324010 556 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:39.324450 556 webserver.cc:460] Webserver started at http://127.25.227.2:45687/ using document root <none> and password file <none>
I20260811 11:05:39.324640 556 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:39.324679 556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:39.324774 556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:39.325870 556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "c227a8aa44614f6a88287f1f31d5ff37"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "f99225565ee1d40e9033abe25de402fd"
server_key_iv: "036b0a20a79fcab6df2aaa6f345c8bcf"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.326170 556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "c227a8aa44614f6a88287f1f31d5ff37"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "f99225565ee1d40e9033abe25de402fd"
server_key_iv: "036b0a20a79fcab6df2aaa6f345c8bcf"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.327432 556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:05:39.328085 584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.328269 556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:39.328368 556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "c227a8aa44614f6a88287f1f31d5ff37"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "f99225565ee1d40e9033abe25de402fd"
server_key_iv: "036b0a20a79fcab6df2aaa6f345c8bcf"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.328485 556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:39.343051 556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:39.344836 556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:39.345000 556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:39.345285 556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:39.345623 556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:39.345687 556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.345731 556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:39.345758 556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.351716 556 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:40839
I20260811 11:05:39.351794 775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:40839 every 8 connection(s)
I20260811 11:05:39.352113 556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:39.353083 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 556
I20260811 11:05:39.353225 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:39.353434 26508 external_mini_cluster.cc:1428] Setting key d3b80f7c74cbfe24ba1981c877ce28d7
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:39.362890 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.352898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:47289 (local address 127.25.227.62:36841)
0811 11:05:39.352981 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:39.352983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:39.353243 (+ 260us) server_negotiation.cc:407] Connection header received
0811 11:05:39.354557 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:39.354558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:39.354569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:39.354619 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:39.355480 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.356020 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.357031 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.357393 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.357465 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.359664 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:39.359666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:39.359666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:39.359675 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:39.361444 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.361842 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.361844 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.361844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.361912 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.362181 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.362183 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.362183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.362344 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:39.362418 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:39.362679 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 11:05:39.362766 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:05:39.362998 778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.352851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36841 (local address 127.25.227.2:47289)
0811 11:05:39.353043 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:39.353095 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:39.354453 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:39.354688 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:39.354692 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:39.355101 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:39.355390 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:39.355397 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.356122 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.356123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:39.356934 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:39.356936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.357490 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.357491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:39.357596 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.358138 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:39.358147 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:39.359564 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:39.361537 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:39.361543 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:39.361545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:39.361763 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:39.361983 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:39.361984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:39.361984 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:39.362104 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:39.362415 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:39.362420 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:39.362535 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 11:05:39.362619 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 11:05:39.362739 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260811 11:05:39.363586 776 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36841
I20260811 11:05:39.363698 776 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
I20260811 11:05:39.363884 776 heartbeater.cc:511] Master 127.25.227.62:36841 requested a full tablet report, sending...
I20260811 11:05:39.364331 32698 ts_manager.cc:194] Registered new tserver with Master: c227a8aa44614f6a88287f1f31d5ff37 (127.25.227.2:40839)
I20260811 11:05:39.364711 32698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:47289
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:39.381575 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36841
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:39.465504 784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:39.465713 784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:39.465736 784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:39.466815 784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:39.466848 784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:39.466873 784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:39.468308 784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:36841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:39.468493 784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:39.468742 784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:39.473838 798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:39.473862 792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:39.473862 794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:39.474077 784 server_base.cc:1034] running on GCE node
I20260811 11:05:39.474365 784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:39.474591 784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:39.475734 784 hybrid_clock.cc:648] HybridClock initialized: now 1786446339475718 us; error 37 us; skew 500 ppm
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:39.478355 784 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:39.478842 784 webserver.cc:460] Webserver started at http://127.25.227.3:45475/ using document root <none> and password file <none>
I20260811 11:05:39.479072 784 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:39.479117 784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:39.479277 784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:39.480350 784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "070b86fb857b41338cb4aaf84a229a6e"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "d675dc492ef04cf89de1ada35beb239b"
server_key_iv: "364c28e15be489febb5cbccdae6a8f77"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.480712 784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "070b86fb857b41338cb4aaf84a229a6e"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "d675dc492ef04cf89de1ada35beb239b"
server_key_iv: "364c28e15be489febb5cbccdae6a8f77"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.482151 784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:39.482899 813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.483120 784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:39.483201 784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "070b86fb857b41338cb4aaf84a229a6e"
format_stamp: "Formatted at 2026-08-11 11:05:39 on dist-test-slave-z8x9"
server_key: "d675dc492ef04cf89de1ada35beb239b"
server_key_iv: "364c28e15be489febb5cbccdae6a8f77"
server_key_version: "encryptionkey@0"
I20260811 11:05:39.483282 784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:39.513031 784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:39.514995 784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:39.515161 784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:39.515408 784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:39.515717 784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:39.515780 784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.515844 784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:39.515877 784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:39.521915 784 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:46555
I20260811 11:05:39.521961 995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:46555 every 8 connection(s)
I20260811 11:05:39.522296 784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:39.527495 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 784
I20260811 11:05:39.527622 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:39.527815 26508 external_mini_cluster.cc:1428] Setting key fc5ff66304da66d2b7cb878971c109b1
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:39.532030 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.523055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35719 (local address 127.25.227.62:36841)
0811 11:05:39.523116 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:39.523118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:39.523320 (+ 202us) server_negotiation.cc:407] Connection header received
0811 11:05:39.524298 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:39.524299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:39.524313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:39.524370 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:39.525000 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.525575 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.526568 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.526785 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.526873 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.529518 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:39.529519 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:39.529519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:39.529526 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:39.530737 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.531193 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.531193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.531194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.531248 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.531512 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.531513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.531513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.531615 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:39.531665 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:39.531903 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 11:05:39.531967 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:05:39.532248 1002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.523050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:36841 (local address 127.25.227.3:35719)
0811 11:05:39.523199 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:39.523236 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:39.524182 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:39.524439 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:39.524443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:39.524717 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:39.524905 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:39.524909 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.525671 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.525672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:39.526474 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:39.526476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.526885 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.526886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:39.527008 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.527522 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:39.527531 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:39.529403 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:39.530810 (+ 1407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:39.530817 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:39.530818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:39.531056 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:39.531327 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:39.531328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:39.531328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:39.531454 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:39.531671 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:39.531675 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:39.531794 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 11:05:39.531876 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:05:39.532000 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260811 11:05:39.532663 997 heartbeater.cc:347] Connected to a master server at 127.25.227.62:36841
I20260811 11:05:39.532743 997 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:39.532930 997 heartbeater.cc:511] Master 127.25.227.62:36841 requested a full tablet report, sending...
I20260811 11:05:39.533329 32698 ts_manager.cc:194] Registered new tserver with Master: 070b86fb857b41338cb4aaf84a229a6e (127.25.227.3:46555)
I20260811 11:05:39.533836 32698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:35719
I20260811 11:05:39.539506 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:39.564399 1009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.556385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54084 (local address 127.25.227.1:42773)
0811 11:05:39.556557 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:39.556569 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:39.556580 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:05:39.556608 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:39.556610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:39.556624 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:39.556699 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:39.557315 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.558040 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.558730 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.559046 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.559100 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.561461 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:39.561471 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:39.561471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:39.561478 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:39.563260 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.563661 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.563664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.563664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.563725 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.563899 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.563900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.563900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.564042 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:39.564145 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:39.564210 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 11:05:39.564279 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[32620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:39.571943 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:39.565752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.25.227.62:36841)
0811 11:05:39.565797 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:39.565799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:39.565836 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:05:39.565891 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:39.565892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:39.565901 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:39.565949 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:39.566385 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.566852 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.567470 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:39.567646 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:39.567695 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:39.569785 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:39.569787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:39.569787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:39.569794 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:39.570930 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.571228 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.571229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.571229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.571283 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:39.571444 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:39.571444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:39.571445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:39.571582 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:39.571688 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:39.571818 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 11:05:39.571879 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 11:05:39.572218 32698 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54600
I20260811 11:05:39.572649 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 322
I20260811 11:05:39.587849 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 556
I20260811 11:05:39.603286 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 784
I20260811 11:05:39.617455 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32638
2026-08-11T11:05:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2175 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[1020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[1020](info): set up 2 sockets
Aug 11 11:05:39 dist-test-slave-z8x9 krb5kdc[1020](info): commencing operation
krb5kdc: starting...
W20260811 11:05:40.922649 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:41.046065 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35959
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:45885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:41.128633 1037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:41.128896 1037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:41.128939 1037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:41.130119 1037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:41.130195 1037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:41.130220 1037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:41.130242 1037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:41.130301 1037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:41.131824 1037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:41.132114 1037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:41.132354 1037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:41.137419 1045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.137422 1046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.137456 1048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:41.137606 1037 server_base.cc:1034] running on GCE node
I20260811 11:05:41.137948 1037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:41.138247 1037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:41.139424 1037 hybrid_clock.cc:648] HybridClock initialized: now 1786446341139400 us; error 36 us; skew 500 ppm
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:41.142342 1037 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:41.142664 1037 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:41.142709 1037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:41.142815 1037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:41.143873 1037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "af2d9dc3771a45e4bdbe2339a0d42944"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "44cd416d0f1a455f6fe3c38492b08095"
server_key_iv: "397a3390ac093c14f42e892cc8775a9c"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.144183 1037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "af2d9dc3771a45e4bdbe2339a0d42944"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "44cd416d0f1a455f6fe3c38492b08095"
server_key_iv: "397a3390ac093c14f42e892cc8775a9c"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.145612 1037 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:05:41.146379 1056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.146575 1037 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:41.146670 1037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "af2d9dc3771a45e4bdbe2339a0d42944"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "44cd416d0f1a455f6fe3c38492b08095"
server_key_iv: "397a3390ac093c14f42e892cc8775a9c"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.146749 1037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:41.159718 1037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:41.161733 1037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:41.161899 1037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:41.166028 1037 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35959
I20260811 11:05:41.166080 1151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35959 every 8 connection(s)
I20260811 11:05:41.166383 1037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:41.167524 1152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:41.169934 1152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944: Bootstrap starting.
I20260811 11:05:41.170507 1152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:41.170773 1152 log.cc:824] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:41.170974 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1037
I20260811 11:05:41.171100 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:41.171298 26508 external_mini_cluster.cc:1428] Setting key 6ee76b4725306f7545c9e9aeb89aaabf
I20260811 11:05:41.171600 1152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944: No bootstrap required, opened a new log
I20260811 11:05:41.174455 1152 raft_consensus.cc:348] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35959 } }
I20260811 11:05:41.174620 1152 raft_consensus.cc:374] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:41.174669 1152 raft_consensus.cc:729] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af2d9dc3771a45e4bdbe2339a0d42944, State: Initialized, Role: FOLLOWER
I20260811 11:05:41.174844 1152 consensus_queue.cc:260] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35959 } }
I20260811 11:05:41.174942 1152 raft_consensus.cc:388] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:41.174988 1152 raft_consensus.cc:482] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:41.175035 1152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:41.175602 1152 raft_consensus.cc:504] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35959 } }
I20260811 11:05:41.175729 1152 leader_election.cc:302] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af2d9dc3771a45e4bdbe2339a0d42944; no voters:
I20260811 11:05:41.175915 1152 leader_election.cc:288] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:41.175981 1159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:41.176144 1159 raft_consensus.cc:686] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [term 1 LEADER]: Becoming Leader. State: Replica: af2d9dc3771a45e4bdbe2339a0d42944, State: Running, Role: LEADER
I20260811 11:05:41.176275 1152 sys_catalog.cc:564] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:41.176247 1159 consensus_queue.cc:237] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35959 } }
I20260811 11:05:41.176607 1162 sys_catalog.cc:455] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af2d9dc3771a45e4bdbe2339a0d42944. Latest consensus state: current_term: 1 leader_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35959 } } }
I20260811 11:05:41.176879 1162 sys_catalog.cc:458] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:41.176796 1161 sys_catalog.cc:455] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2d9dc3771a45e4bdbe2339a0d42944" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35959 } } }
I20260811 11:05:41.177196 1161 sys_catalog.cc:458] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:41.177385 1172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:41.177951 1172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:41.179827 1172 catalog_manager.cc:1347] Generated new cluster ID: 8f68f324a6ba474187cd69ffa17dc8eb
I20260811 11:05:41.179879 1172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:41.183816 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.171830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44072 (local address 127.25.227.62:35959)
0811 11:05:41.172019 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.172027 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.172056 (+ 29us) server_negotiation.cc:407] Connection header received
0811 11:05:41.172953 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.172961 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.173012 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.173129 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:41.173967 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.174942 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.175840 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.176539 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.177409 (+ 870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.179752 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:41.179764 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:41.179764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:41.179779 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:41.181833 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.182262 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.182265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.182266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.182395 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.182646 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.182646 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.182647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.182973 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:41.183119 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.183268 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.183404 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260811 11:05:41.200320 1172 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:41.201107 1172 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:41.210160 1172 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944: Generated new TSK 0
I20260811 11:05:41.210362 1172 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:41.247910 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35959
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:45885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:41.331705 1193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:41.331913 1193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:41.331936 1193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:41.333205 1193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:41.333246 1193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:41.333273 1193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:41.334890 1193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:41.335107 1193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:41.335342 1193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:41.340322 1208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.340335 1202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.340365 1205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:41.340557 1193 server_base.cc:1034] running on GCE node
I20260811 11:05:41.340773 1193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:41.341027 1193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:41.342206 1193 hybrid_clock.cc:648] HybridClock initialized: now 1786446341342180 us; error 40 us; skew 500 ppm
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:41.344808 1193 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:41.345155 1193 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:41.345296 1193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:41.345398 1193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:41.346405 1193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "b103134c5da7479ebfdc00cc823fc355"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "6282c35ee32ad6f675538828776476f6"
server_key_iv: "1c61057e2d3e78f1910e5dc6a3c824e7"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.346711 1193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "b103134c5da7479ebfdc00cc823fc355"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "6282c35ee32ad6f675538828776476f6"
server_key_iv: "1c61057e2d3e78f1910e5dc6a3c824e7"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.347993 1193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:05:41.348681 1219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.348865 1193 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:41.348951 1193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "b103134c5da7479ebfdc00cc823fc355"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "6282c35ee32ad6f675538828776476f6"
server_key_iv: "1c61057e2d3e78f1910e5dc6a3c824e7"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.349007 1193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:41.364609 1193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:41.366588 1193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:41.366703 1193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:41.366882 1193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:41.367133 1193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:41.367164 1193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.367185 1193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:41.367198 1193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.372880 1193 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:46163
I20260811 11:05:41.372958 1395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:46163 every 8 connection(s)
I20260811 11:05:41.373283 1193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:41.373610 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1193
I20260811 11:05:41.373746 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:41.373953 26508 external_mini_cluster.cc:1428] Setting key 48a8e974c900fcdc5f79a2025d4e5cdc
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:41.384215 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.374047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:58067 (local address 127.25.227.62:35959)
0811 11:05:41.374099 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.374101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.374372 (+ 271us) server_negotiation.cc:407] Connection header received
0811 11:05:41.374977 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.374978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.374989 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.375031 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:41.376390 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.377205 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.378313 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.378649 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.378725 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.381188 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:41.381190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:41.381190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:41.381199 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:41.382825 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.383219 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.383221 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.383221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.383291 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.383535 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.383536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.383537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.383689 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:41.383773 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.384023 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.384121 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:05:41.384299 1400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.374043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35959 (local address 127.25.227.1:58067)
0811 11:05:41.374200 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.374268 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.374873 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.375096 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.375100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.375496 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:41.376288 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.376295 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.377316 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.377317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.378182 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.378185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.378739 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.378740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.378848 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.379385 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:41.379394 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:41.381064 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:41.382912 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:41.382920 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:41.382922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:41.383138 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:41.383365 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:41.383365 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:41.383366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:41.383466 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:41.383768 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:41.383772 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:41.383885 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.383972 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.384093 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
I20260811 11:05:41.384894 1396 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35959
I20260811 11:05:41.384987 1396 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:41.385113 1396 heartbeater.cc:511] Master 127.25.227.62:35959 requested a full tablet report, sending...
I20260811 11:05:41.385703 1080 ts_manager.cc:194] Registered new tserver with Master: b103134c5da7479ebfdc00cc823fc355 (127.25.227.1:46163)
I20260811 11:05:41.386348 1080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:58067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:41.402444 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35959
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:45885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:41.486255 1403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:41.486454 1403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:41.486477 1403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:41.487639 1403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:41.487684 1403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:41.487711 1403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:41.489293 1403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:41.489544 1403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:41.489812 1403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:41.494792 1417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.494822 1414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:41.494930 1403 server_base.cc:1034] running on GCE node
W20260811 11:05:41.494828 1411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:41.495281 1403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:41.495483 1403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:41.496654 1403 hybrid_clock.cc:648] HybridClock initialized: now 1786446341496644 us; error 26 us; skew 500 ppm
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:41.499325 1403 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:41.499686 1403 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:41.499759 1403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:41.499917 1403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:41.500958 1403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "44c075b8b5ee4d869838eebc621b24ea"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "c9197c8d38abb5200262069d5a39c22f"
server_key_iv: "aab92c8e16ad0e2d7ddcff17e0036d85"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.501345 1403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "44c075b8b5ee4d869838eebc621b24ea"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "c9197c8d38abb5200262069d5a39c22f"
server_key_iv: "aab92c8e16ad0e2d7ddcff17e0036d85"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.502638 1403 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:41.503355 1428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.503527 1403 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:41.503636 1403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "44c075b8b5ee4d869838eebc621b24ea"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "c9197c8d38abb5200262069d5a39c22f"
server_key_iv: "aab92c8e16ad0e2d7ddcff17e0036d85"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.503710 1403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:41.532187 1403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:41.534689 1403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:41.534857 1403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:41.535099 1403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:41.535442 1403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:41.535501 1403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.535547 1403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:41.535575 1403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.541694 1403 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:36285
I20260811 11:05:41.541800 1620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:36285 every 8 connection(s)
I20260811 11:05:41.542092 1403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:41.547989 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1403
I20260811 11:05:41.548098 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:41.548295 26508 external_mini_cluster.cc:1428] Setting key e33356a712819f0a28482cb77013e805
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:41.554630 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.544784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:49105 (local address 127.25.227.62:35959)
0811 11:05:41.544852 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.544854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.545052 (+ 198us) server_negotiation.cc:407] Connection header received
0811 11:05:41.545664 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.545666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.545679 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.545726 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:41.546711 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.547228 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.548561 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.548838 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.548929 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.551387 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:41.551389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:41.551389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:41.551398 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:41.552970 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.553542 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.553543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.553543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.553600 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.553931 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.553932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.553932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.554068 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:41.554121 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.554494 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.554563 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:41.554947 1628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.544752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35959 (local address 127.25.227.2:49105)
0811 11:05:41.544919 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.544968 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.545546 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.545812 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.545816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.546088 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:41.546603 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.546613 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.547329 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.547331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.548468 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.548471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.549013 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.549014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.549202 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.549767 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:41.549776 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:41.551296 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:41.553046 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:41.553054 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:41.553057 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:41.553460 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:41.553673 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:41.553674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:41.553674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:41.553836 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:41.554139 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:41.554147 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:41.554338 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.554458 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.554651 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260811 11:05:41.555539 1621 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35959
I20260811 11:05:41.555637 1621 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:41.555810 1621 heartbeater.cc:511] Master 127.25.227.62:35959 requested a full tablet report, sending...
I20260811 11:05:41.556190 1080 ts_manager.cc:194] Registered new tserver with Master: 44c075b8b5ee4d869838eebc621b24ea (127.25.227.2:36285)
I20260811 11:05:41.556592 1080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:49105
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:41.575922 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35959
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:45885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:41.659348 1631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:41.659590 1631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:41.659631 1631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:41.660840 1631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:41.660915 1631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:41.660964 1631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:41.662547 1631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:41.662837 1631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:41.663075 1631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:41.668047 1636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.668085 1640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:41.668074 1637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:41.668299 1631 server_base.cc:1034] running on GCE node
I20260811 11:05:41.668615 1631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:41.669020 1631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:41.670228 1631 hybrid_clock.cc:648] HybridClock initialized: now 1786446341670202 us; error 34 us; skew 500 ppm
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:41.673094 1631 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:41.673616 1631 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:41.673676 1631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:41.673871 1631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:41.674998 1631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "4e5f9693d43a2823ed9c2aa5a694ee89"
server_key_iv: "2e2e411c38b61ec1e4d0a7d1f2ebd0df"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.675401 1631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "4e5f9693d43a2823ed9c2aa5a694ee89"
server_key_iv: "2e2e411c38b61ec1e4d0a7d1f2ebd0df"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.676944 1631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:41.677984 1655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.678201 1631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:41.678319 1631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d"
format_stamp: "Formatted at 2026-08-11 11:05:41 on dist-test-slave-z8x9"
server_key: "4e5f9693d43a2823ed9c2aa5a694ee89"
server_key_iv: "2e2e411c38b61ec1e4d0a7d1f2ebd0df"
server_key_version: "encryptionkey@0"
I20260811 11:05:41.678397 1631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:41.700354 1631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:41.702359 1631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:41.702517 1631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:41.702766 1631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:41.703088 1631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:41.703125 1631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.703148 1631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:41.703199 1631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:41.709970 1631 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:38695
I20260811 11:05:41.710013 1880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:38695 every 8 connection(s)
I20260811 11:05:41.710294 1631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:41.711738 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1631
I20260811 11:05:41.711848 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:41.712049 26508 external_mini_cluster.cc:1428] Setting key 6475bcb9fe100209c7b6008f8cbec4a3
Aug 11 11:05:41 dist-test-slave-z8x9 krb5kdc[1020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446341, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:41.719519 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.711031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:45837 (local address 127.25.227.62:35959)
0811 11:05:41.711094 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.711096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.711273 (+ 177us) server_negotiation.cc:407] Connection header received
0811 11:05:41.711878 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.711879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.711892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.711962 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:41.713275 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.713764 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.714741 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.714925 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.714986 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.717048 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:41.717049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:41.717049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:41.717055 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:41.718338 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.718706 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.718707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.718707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.718765 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.718986 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.718986 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.718986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.719090 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:41.719141 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.719387 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.719453 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:05:41.719669 1884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.711002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35959 (local address 127.25.227.3:45837)
0811 11:05:41.711160 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.711201 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.711761 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.712040 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.712044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.712407 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:41.713153 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.713159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.713847 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.713848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.714658 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.714661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.715032 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.715033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.715143 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.715602 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:41.715610 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:41.716965 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:41.718409 (+ 1444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:41.718415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:41.718417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:41.718638 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:41.718826 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:41.718827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:41.718827 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:41.718929 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:41.719144 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:41.719148 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:41.719270 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.719353 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.719473 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260811 11:05:41.720170 1881 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35959
I20260811 11:05:41.720273 1881 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:41.720439 1881 heartbeater.cc:511] Master 127.25.227.62:35959 requested a full tablet report, sending...
I20260811 11:05:41.720866 1080 ts_manager.cc:194] Registered new tserver with Master: 1f03cdf3fd014eea8b1dddb8dcebdc0d (127.25.227.3:38695)
I20260811 11:05:41.721313 1080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:45837
I20260811 11:05:41.723806 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:05:41.730697 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.725092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44082 (local address 127.25.227.62:35959)
0811 11:05:41.725146 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.725148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.725273 (+ 125us) server_negotiation.cc:407] Connection header received
0811 11:05:41.725339 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.725339 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.725348 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.725386 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:41.725904 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.726361 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.727037 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.727215 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.727281 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.728417 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:41.728418 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:41.728418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:41.728424 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:41.729657 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.730023 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.730024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.730024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.730077 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:41.730273 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:41.730274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:41.730274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:41.730406 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:41.730481 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.730577 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.730637 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 11:05:41.732191 1080 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:41.733868 1080 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:41.740509 1900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.736209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46163 (local address 127.0.0.1:37868)
0811 11:05:41.736435 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.736483 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.736551 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.737063 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.737064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.737066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:41.737117 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.737135 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.738152 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.738153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.739232 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.739235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.740193 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.740194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.740277 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.740291 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.740365 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.740425 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":51,"threads_started":1}
I20260811 11:05:41.740634 1907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.736274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:36285 (local address 127.0.0.1:47330)
0811 11:05:41.736653 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.736662 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.736700 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.736940 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.736943 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.736945 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:41.737036 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.737039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.738436 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.738437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.739482 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.739485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.740326 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.740327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.740397 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.740401 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.740446 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.740478 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":9,"thread_start_us":86,"threads_started":1}
I20260811 11:05:41.740789 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.736516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.25.227.2:36285)
0811 11:05:41.736687 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.736699 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.736709 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:41.736798 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.736801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.736820 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.736910 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:41.737142 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.738315 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.739574 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.740113 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.740219 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.740290 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.740555 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.740605 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":74,"threads_started":1}
I20260811 11:05:41.740849 1899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.736259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:38695 (local address 127.0.0.1:58880)
0811 11:05:41.736618 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.736628 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.736677 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.737415 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.737416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.737418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:41.737463 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.737464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.738668 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.738669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.739639 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.739642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.740602 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.740603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.740684 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.740689 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.740740 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.740783 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":101,"threads_started":1}
I20260811 11:05:41.741114 1912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.736500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58880 (local address 127.25.227.3:38695)
0811 11:05:41.737247 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.737253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.737263 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:41.737299 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.737301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.737316 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.737401 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:41.737538 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.738557 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.739722 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.740440 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.740509 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.740562 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.740955 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.741020 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":84,"threads_started":1}
I20260811 11:05:41.740545 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.736409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37868 (local address 127.25.227.1:46163)
0811 11:05:41.736790 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.736794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.736801 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:05:41.736862 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.736865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.736881 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.736960 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:41.737237 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.738047 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.739333 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.740085 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.740163 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.740236 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.740402 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.740451 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":111,"threads_started":1}
I20260811 11:05:41.741547 1500 tablet_service.cc:1467] Processing CreateTablet for tablet e6ec605e131d4705aace54fe87728e68 (DEFAULT_TABLE table=test-table [id=eeb16aeaa62f4460b109b15fa83656f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:41.741968 1500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ec605e131d4705aace54fe87728e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:41.742267 1294 tablet_service.cc:1467] Processing CreateTablet for tablet e6ec605e131d4705aace54fe87728e68 (DEFAULT_TABLE table=test-table [id=eeb16aeaa62f4460b109b15fa83656f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:41.742607 1294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ec605e131d4705aace54fe87728e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:41.745548 1914 tablet_bootstrap.cc:492] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Bootstrap starting.
I20260811 11:05:41.745635 1740 tablet_service.cc:1467] Processing CreateTablet for tablet e6ec605e131d4705aace54fe87728e68 (DEFAULT_TABLE table=test-table [id=eeb16aeaa62f4460b109b15fa83656f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:41.745981 1740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ec605e131d4705aace54fe87728e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:41.745990 1915 tablet_bootstrap.cc:492] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: Bootstrap starting.
I20260811 11:05:41.746318 1914 tablet_bootstrap.cc:654] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:41.746668 1915 tablet_bootstrap.cc:654] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:41.747071 1914 log.cc:824] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:41.747200 1915 log.cc:824] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:41.747922 1915 tablet_bootstrap.cc:492] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: No bootstrap required, opened a new log
I20260811 11:05:41.748010 1915 ts_tablet_manager.cc:1397] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:41.748013 1914 tablet_bootstrap.cc:492] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: No bootstrap required, opened a new log
I20260811 11:05:41.748078 1914 ts_tablet_manager.cc:1397] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:05:41.749591 1922 tablet_bootstrap.cc:492] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Bootstrap starting.
I20260811 11:05:41.749734 1915 raft_consensus.cc:348] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.749902 1915 raft_consensus.cc:374] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:41.749950 1915 raft_consensus.cc:729] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b103134c5da7479ebfdc00cc823fc355, State: Initialized, Role: FOLLOWER
I20260811 11:05:41.750082 1915 consensus_queue.cc:260] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.750391 1915 ts_tablet_manager.cc:1428] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 11:05:41.750445 1922 tablet_bootstrap.cc:654] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:41.750442 1396 heartbeater.cc:503] Master 127.25.227.62:35959 was elected leader, sending a full tablet report...
I20260811 11:05:41.750331 1914 raft_consensus.cc:348] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.750487 1914 raft_consensus.cc:374] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:41.750521 1914 raft_consensus.cc:729] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c075b8b5ee4d869838eebc621b24ea, State: Initialized, Role: FOLLOWER
I20260811 11:05:41.750633 1914 consensus_queue.cc:260] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.750942 1914 ts_tablet_manager.cc:1428] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 11:05:41.750942 1621 heartbeater.cc:503] Master 127.25.227.62:35959 was elected leader, sending a full tablet report...
I20260811 11:05:41.751056 1922 log.cc:824] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:41.752108 1922 tablet_bootstrap.cc:492] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: No bootstrap required, opened a new log
I20260811 11:05:41.752197 1922 ts_tablet_manager.cc:1397] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:05:41.754143 1922 raft_consensus.cc:348] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.754273 1922 raft_consensus.cc:374] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:41.754295 1922 raft_consensus.cc:729] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f03cdf3fd014eea8b1dddb8dcebdc0d, State: Initialized, Role: FOLLOWER
I20260811 11:05:41.754370 1922 consensus_queue.cc:260] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.754673 1922 ts_tablet_manager.cc:1428] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 11:05:41.754745 1881 heartbeater.cc:503] Master 127.25.227.62:35959 was elected leader, sending a full tablet report...
W20260811 11:05:41.792737 1625 tablet.cc:2369] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:41.851943 1928 raft_consensus.cc:482] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:41.852072 1928 raft_consensus.cc:504] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.852490 1928 leader_election.cc:288] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b103134c5da7479ebfdc00cc823fc355 (127.25.227.1:46163), 44c075b8b5ee4d869838eebc621b24ea (127.25.227.2:36285)
I20260811 11:05:41.855502 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.852865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:52417 (local address 127.25.227.1:46163)
0811 11:05:41.852908 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.852910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.852999 (+ 89us) server_negotiation.cc:407] Connection header received
0811 11:05:41.853046 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.853047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.853057 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.853117 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:41.853329 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.853808 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.854767 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.855125 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.855183 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.855190 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.855378 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.855427 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:05:41.855504 1934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.852692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46163 (local address 127.25.227.3:52417)
0811 11:05:41.852918 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.852931 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.852988 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.853132 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.853150 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.853152 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:41.853250 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.853252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.853893 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.853894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.854641 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.854643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.855215 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.855216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.855300 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.855303 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.855354 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.855412 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":161,"threads_started":1}
I20260811 11:05:41.855515 1884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.852655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:36285 (local address 127.25.227.3:58767)
0811 11:05:41.852718 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.852732 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:41.852782 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:41.853016 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:41.853017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:41.853019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:41.853101 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.853103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.853808 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.853809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.854610 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:41.854613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.855252 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.855253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:41.855329 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.855332 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:41.855405 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:05:41.855442 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 11:05:41.855549 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.852801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:58767 (local address 127.25.227.2:36285)
0811 11:05:41.852868 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.852871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.852882 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:05:41.852913 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.852914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.852925 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.852998 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:41.853201 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.853730 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.854713 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.855133 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.855229 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.855238 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.855430 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.855475 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:05:41.855964 1539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ec605e131d4705aace54fe87728e68" candidate_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c075b8b5ee4d869838eebc621b24ea" is_pre_election: true
I20260811 11:05:41.856118 1539 raft_consensus.cc:2454] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f03cdf3fd014eea8b1dddb8dcebdc0d in term 0.
I20260811 11:05:41.856170 1320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ec605e131d4705aace54fe87728e68" candidate_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b103134c5da7479ebfdc00cc823fc355" is_pre_election: true
I20260811 11:05:41.856350 1320 raft_consensus.cc:2454] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f03cdf3fd014eea8b1dddb8dcebdc0d in term 0.
I20260811 11:05:41.856360 1656 leader_election.cc:302] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f03cdf3fd014eea8b1dddb8dcebdc0d, 44c075b8b5ee4d869838eebc621b24ea; no voters:
I20260811 11:05:41.856503 1928 raft_consensus.cc:2781] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:41.856564 1928 raft_consensus.cc:482] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:41.856608 1928 raft_consensus.cc:3037] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:41.857436 1928 raft_consensus.cc:504] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.857586 1928 leader_election.cc:288] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [CANDIDATE]: Term 1 election: Requested vote from peers b103134c5da7479ebfdc00cc823fc355 (127.25.227.1:46163), 44c075b8b5ee4d869838eebc621b24ea (127.25.227.2:36285)
I20260811 11:05:41.857748 1539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ec605e131d4705aace54fe87728e68" candidate_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c075b8b5ee4d869838eebc621b24ea"
I20260811 11:05:41.857758 1320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ec605e131d4705aace54fe87728e68" candidate_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b103134c5da7479ebfdc00cc823fc355"
I20260811 11:05:41.857841 1539 raft_consensus.cc:3037] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:41.857841 1320 raft_consensus.cc:3037] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:41.858757 1320 raft_consensus.cc:2454] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f03cdf3fd014eea8b1dddb8dcebdc0d in term 1.
I20260811 11:05:41.858764 1539 raft_consensus.cc:2454] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f03cdf3fd014eea8b1dddb8dcebdc0d in term 1.
I20260811 11:05:41.858928 1666 leader_election.cc:302] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f03cdf3fd014eea8b1dddb8dcebdc0d, b103134c5da7479ebfdc00cc823fc355; no voters:
I20260811 11:05:41.859031 1928 raft_consensus.cc:2781] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:41.859174 1928 raft_consensus.cc:686] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 1 LEADER]: Becoming Leader. State: Replica: 1f03cdf3fd014eea8b1dddb8dcebdc0d, State: Running, Role: LEADER
I20260811 11:05:41.859283 1928 consensus_queue.cc:237] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } }
I20260811 11:05:41.860128 1080 catalog_manager.cc:5495] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f03cdf3fd014eea8b1dddb8dcebdc0d (127.25.227.3). New cstate: current_term: 1 leader_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f03cdf3fd014eea8b1dddb8dcebdc0d" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 } health_report { overall_health: UNKNOWN } } }
W20260811 11:05:41.873979 1398 tablet.cc:2369] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:41.884034 1912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.881812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58890 (local address 127.25.227.3:38695)
0811 11:05:41.881854 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:41.881857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:41.881871 (+ 14us) server_negotiation.cc:407] Connection header received
0811 11:05:41.881923 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:41.881923 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:41.881942 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:41.882006 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:41.882121 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.882624 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.883369 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:41.883550 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:41.883600 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:41.883736 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:41.883843 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:41.883903 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:41.883940 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 11:05:41.883957 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 11:05:41.885958 1320 raft_consensus.cc:1261] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 1 FOLLOWER]: Refusing update from remote peer 1f03cdf3fd014eea8b1dddb8dcebdc0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:41.885960 1539 raft_consensus.cc:1261] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 1 FOLLOWER]: Refusing update from remote peer 1f03cdf3fd014eea8b1dddb8dcebdc0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:41.886343 1928 consensus_queue.cc:1035] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c075b8b5ee4d869838eebc621b24ea" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:41.886483 1937 consensus_queue.cc:1035] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b103134c5da7479ebfdc00cc823fc355" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:41.889521 1944 mvcc.cc:205] Tried to move back new op lower bound from 7317284216362135552 to 7317284216256225280. Current Snapshot: MvccSnapshot[applied={T|T < 7317284216362135552 or (T in {7317284216362135552})}]
I20260811 11:05:41.891351 1079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:41.891479 1079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:41.892273 1079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af2d9dc3771a45e4bdbe2339a0d42944: Sending DeleteTablet for 3 replicas of tablet e6ec605e131d4705aace54fe87728e68
I20260811 11:05:41.892602 1294 tablet_service.cc:1514] Processing DeleteTablet for tablet e6ec605e131d4705aace54fe87728e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:41 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:37868
I20260811 11:05:41.892621 1500 tablet_service.cc:1514] Processing DeleteTablet for tablet e6ec605e131d4705aace54fe87728e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:41 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:47330
I20260811 11:05:41.892750 1740 tablet_service.cc:1514] Processing DeleteTablet for tablet e6ec605e131d4705aace54fe87728e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:41 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:58880
I20260811 11:05:41.892977 1963 tablet_replica.cc:330] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: stopping tablet replica
I20260811 11:05:41.893088 1963 raft_consensus.cc:2229] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:41.893209 1963 raft_consensus.cc:2258] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:41.893338 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1193
I20260811 11:05:41.893343 1961 tablet_replica.cc:330] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355: stopping tablet replica
I20260811 11:05:41.893496 1961 raft_consensus.cc:2229] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:41.893640 1961 raft_consensus.cc:2258] T e6ec605e131d4705aace54fe87728e68 P b103134c5da7479ebfdc00cc823fc355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:41.896652 1963 ts_tablet_manager.cc:1905] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:41.900231 1963 ts_tablet_manager.cc:1918] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:41.900338 1963 log.cc:1196] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/e6ec605e131d4705aace54fe87728e68
I20260811 11:05:41.900693 1963 ts_tablet_manager.cc:1939] T e6ec605e131d4705aace54fe87728e68 P 1f03cdf3fd014eea8b1dddb8dcebdc0d: Deleting consensus metadata
I20260811 11:05:41.905336 1962 tablet_replica.cc:330] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: stopping tablet replica
I20260811 11:05:41.905532 1962 raft_consensus.cc:2229] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:41.905699 1962 raft_consensus.cc:2258] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:41.909147 1962 ts_tablet_manager.cc:1905] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:41.909312 1060 catalog_manager.cc:4841] TS 1f03cdf3fd014eea8b1dddb8dcebdc0d (127.25.227.3:38695): tablet e6ec605e131d4705aace54fe87728e68 (table test-table [id=eeb16aeaa62f4460b109b15fa83656f2]) successfully deleted
I20260811 11:05:41.910799 1962 ts_tablet_manager.cc:1918] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:41.910900 1962 log.cc:1196] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/e6ec605e131d4705aace54fe87728e68
I20260811 11:05:41.911156 1962 ts_tablet_manager.cc:1939] T e6ec605e131d4705aace54fe87728e68 P 44c075b8b5ee4d869838eebc621b24ea: Deleting consensus metadata
I20260811 11:05:41.911587 1057 catalog_manager.cc:4841] TS 44c075b8b5ee4d869838eebc621b24ea (127.25.227.2:36285): tablet e6ec605e131d4705aace54fe87728e68 (table test-table [id=eeb16aeaa62f4460b109b15fa83656f2]) successfully deleted
W20260811 11:05:41.917601 1061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:46163 (error 108)
I20260811 11:05:41.917819 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1403
I20260811 11:05:41.923671 1899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:41.923542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46163 (local address 127.0.0.1:37870)
0811 11:05:41.923593 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:41.923627 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:46163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 11:05:41.924485 1061 catalog_manager.cc:4584] TS b103134c5da7479ebfdc00cc823fc355 (127.25.227.1:46163): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e6ec605e131d4705aace54fe87728e68: Network error: Client connection negotiation failed: client connection to 127.25.227.1:46163: connect: Connection refused (error 111)
I20260811 11:05:41.938320 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1631
I20260811 11:05:41.952270 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1037
2026-08-11T11:05:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2334 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T11:05:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:41Z Disabled control of system clock
I20260811 11:05:41.988479 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43253
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:43253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 11:05:42.071446 1970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:42.071650 1970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:42.071671 1970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:42.072892 1970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:42.072935 1970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:42.072948 1970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:42.072961 1970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:42.072974 1970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:42.074389 1970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:43253
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:42.074651 1970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:42.074954 1970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:05:42.080209 1970 server_base.cc:1034] running on GCE node
W20260811 11:05:42.080142 1982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.080142 1980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.080148 1985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:42.080641 1970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:42.081007 1970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:42.082167 1970 hybrid_clock.cc:648] HybridClock initialized: now 1786446342082143 us; error 46 us; skew 500 ppm
I20260811 11:05:42.086517 1970 webserver.cc:460] Webserver started at http://127.25.227.62:36131/ using document root <none> and password file <none>
I20260811 11:05:42.086800 1970 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:42.086853 1970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:42.087038 1970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:42.088624 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "6210320f089d4be1b97e86644d2c783c"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "b5957d51c8a518ce13f8a9f86ca313a6"
server_key_iv: "63bf3c73e9a4c964b732ed999b8969e6"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.089071 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "6210320f089d4be1b97e86644d2c783c"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "b5957d51c8a518ce13f8a9f86ca313a6"
server_key_iv: "63bf3c73e9a4c964b732ed999b8969e6"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.091022 1970 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 11:05:42.092028 1995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.092235 1970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:42.092346 1970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "6210320f089d4be1b97e86644d2c783c"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "b5957d51c8a518ce13f8a9f86ca313a6"
server_key_iv: "63bf3c73e9a4c964b732ed999b8969e6"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.092437 1970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:42.095920 1970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:42.096216 1970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:42.096371 1970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:42.100528 1970 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:43253
I20260811 11:05:42.100582 2085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:43253 every 8 connection(s)
I20260811 11:05:42.100960 1970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:42.101738 2087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:42.103072 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1970
I20260811 11:05:42.103180 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:42.103375 26508 external_mini_cluster.cc:1428] Setting key 9fbf577be28f32e439d283d24689398c
I20260811 11:05:42.105759 2087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c: Bootstrap starting.
I20260811 11:05:42.106058 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.103990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.25.227.62:43253)
0811 11:05:42.104183 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.104195 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.104221 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:05:42.104652 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.104658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.104698 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.104817 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.105614 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.105617 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.105618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.105622 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.105663 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.105673 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.105729 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.105818 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.105898 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260811 11:05:42.106577 2087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:42.106928 2087 log.cc:824] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:42.107636 2087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c: No bootstrap required, opened a new log
I20260811 11:05:42.109035 2087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6210320f089d4be1b97e86644d2c783c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43253 } }
I20260811 11:05:42.109221 2087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:42.109269 2087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6210320f089d4be1b97e86644d2c783c, State: Initialized, Role: FOLLOWER
I20260811 11:05:42.109404 2087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6210320f089d4be1b97e86644d2c783c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43253 } }
I20260811 11:05:42.109514 2087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:42.109560 2087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:42.109616 2087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:42.110142 2087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6210320f089d4be1b97e86644d2c783c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43253 } }
I20260811 11:05:42.110352 2087 leader_election.cc:302] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6210320f089d4be1b97e86644d2c783c; no voters:
I20260811 11:05:42.110556 2087 leader_election.cc:288] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:42.110589 2098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:42.110770 2098 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [term 1 LEADER]: Becoming Leader. State: Replica: 6210320f089d4be1b97e86644d2c783c, State: Running, Role: LEADER
I20260811 11:05:42.110859 2087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:42.110937 2098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6210320f089d4be1b97e86644d2c783c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43253 } }
I20260811 11:05:42.111347 2098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6210320f089d4be1b97e86644d2c783c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6210320f089d4be1b97e86644d2c783c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43253 } } }
I20260811 11:05:42.111521 2098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:42.111706 2098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6210320f089d4be1b97e86644d2c783c. Latest consensus state: current_term: 1 leader_uuid: "6210320f089d4be1b97e86644d2c783c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6210320f089d4be1b97e86644d2c783c" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43253 } } }
I20260811 11:05:42.111794 2116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:42.111824 2098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:42.112295 2116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:42.113996 2116 catalog_manager.cc:1347] Generated new cluster ID: 91695e25314147af921ba7d858855bf0
I20260811 11:05:42.114042 2116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:42.121014 2116 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:42.121209 2116 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:42.126163 2116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c: Generated new TSK 0
I20260811 11:05:42.126361 2116 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:05:42.131001 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43253
--builtin_ntp_servers=127.25.227.20:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 11:05:42.220893 2131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:42.221112 2131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:42.221135 2131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:42.222365 2131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:42.222412 2131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:42.222438 2131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:42.223814 2131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:42.224061 2131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:42.224387 2131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:42.230724 2139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.230829 2146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.230746 2140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:42.231032 2131 server_base.cc:1034] running on GCE node
I20260811 11:05:42.231376 2131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:42.231642 2131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:42.232818 2131 hybrid_clock.cc:648] HybridClock initialized: now 1786446342232804 us; error 28 us; skew 500 ppm
I20260811 11:05:42.234364 2131 webserver.cc:460] Webserver started at http://127.25.227.1:41625/ using document root <none> and password file <none>
I20260811 11:05:42.234629 2131 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:42.234689 2131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:42.234838 2131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:42.236295 2131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "5c5ea3ac766a49d896aff2450b755cfb"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "e1a7ac2beb388783ec0e6b4a656853f0"
server_key_iv: "ee3a19c44fb41ad47dcbe0d4d2e5c657"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.236692 2131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "5c5ea3ac766a49d896aff2450b755cfb"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "e1a7ac2beb388783ec0e6b4a656853f0"
server_key_iv: "ee3a19c44fb41ad47dcbe0d4d2e5c657"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.238572 2131 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 11:05:42.239494 2152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.239722 2131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:42.239833 2131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "5c5ea3ac766a49d896aff2450b755cfb"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "e1a7ac2beb388783ec0e6b4a656853f0"
server_key_iv: "ee3a19c44fb41ad47dcbe0d4d2e5c657"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.239914 2131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:42.243261 2131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:42.243534 2131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:42.243682 2131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:42.243901 2131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:42.244212 2131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:42.244246 2131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.244266 2131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:42.244314 2131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.249854 2131 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:43249
I20260811 11:05:42.250272 2131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:42.252343 2353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:43249 every 8 connection(s)
I20260811 11:05:42.253611 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.251078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:52865 (local address 127.25.227.62:43253)
0811 11:05:42.251131 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.251134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.251407 (+ 273us) server_negotiation.cc:407] Connection header received
0811 11:05:42.252040 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.252041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.252048 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.252091 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.253376 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.253378 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.253378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.253383 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.253398 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.253402 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.253459 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.253544 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.253557 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 11:05:42.253825 2360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.251078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43253 (local address 127.25.227.1:52865)
0811 11:05:42.251261 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.251305 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.251917 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.252162 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.252166 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.252177 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.253143 (+ 966us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.253144 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.253224 (+ 80us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.253258 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.253469 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.253474 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.253477 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.253536 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.253586 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260811 11:05:42.254299 2354 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43253
I20260811 11:05:42.254417 2354 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:42.254593 2354 heartbeater.cc:511] Master 127.25.227.62:43253 requested a full tablet report, sending...
I20260811 11:05:42.255149 2019 ts_manager.cc:194] Registered new tserver with Master: 5c5ea3ac766a49d896aff2450b755cfb (127.25.227.1:43249)
I20260811 11:05:42.257355 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2131
I20260811 11:05:42.257473 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:42.257642 26508 external_mini_cluster.cc:1428] Setting key cb8d8601c112ada9c62441604f4279da
I20260811 11:05:42.258569 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43253
--builtin_ntp_servers=127.25.227.20:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 11:05:42.343006 2361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:42.343245 2361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:42.343282 2361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:42.344552 2361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:42.344617 2361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:42.344659 2361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:42.346014 2361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:42.346287 2361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:42.346578 2361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:05:42.351928 2361 server_base.cc:1034] running on GCE node
W20260811 11:05:42.351867 2375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.351869 2371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.351895 2372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:42.352394 2361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:42.352659 2361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:42.353813 2361 hybrid_clock.cc:648] HybridClock initialized: now 1786446342353789 us; error 40 us; skew 500 ppm
I20260811 11:05:42.355118 2361 webserver.cc:460] Webserver started at http://127.25.227.2:44529/ using document root <none> and password file <none>
I20260811 11:05:42.355396 2361 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:42.355470 2361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:42.355607 2361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:42.356940 2361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "195a5dfccfe84785bc8cec5b7e3ce746"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "58e4b93216e744decf421938491ccd08"
server_key_iv: "905d2d4d1a64336e6d2acfce9f6c008b"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.357483 2361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "195a5dfccfe84785bc8cec5b7e3ce746"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "58e4b93216e744decf421938491ccd08"
server_key_iv: "905d2d4d1a64336e6d2acfce9f6c008b"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.358950 2361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:42.359717 2385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.359920 2361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:42.360030 2361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "195a5dfccfe84785bc8cec5b7e3ce746"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "58e4b93216e744decf421938491ccd08"
server_key_iv: "905d2d4d1a64336e6d2acfce9f6c008b"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.360113 2361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:42.363620 2361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:42.363919 2361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:42.364066 2361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:42.364286 2361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:42.364602 2361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:42.364660 2361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.364699 2361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:42.364729 2361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.370661 2361 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:42617
I20260811 11:05:42.370710 2582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:42617 every 8 connection(s)
I20260811 11:05:42.371168 2361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:42.374261 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.371990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:60957 (local address 127.25.227.62:43253)
0811 11:05:42.372046 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.372049 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.372355 (+ 306us) server_negotiation.cc:407] Connection header received
0811 11:05:42.372823 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.372824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.372830 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.372890 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.374021 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.374022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.374022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.374026 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.374043 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.374047 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.374092 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.374193 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.374205 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:42.374358 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2361
I20260811 11:05:42.374451 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:42.374469 2588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.371986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43253 (local address 127.25.227.2:60957)
0811 11:05:42.372220 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.372262 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.372703 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.372936 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.372939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.372947 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.373875 (+ 928us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.373875 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.373903 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.373930 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.374097 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.374099 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.374101 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.374177 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.374241 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260811 11:05:42.374650 26508 external_mini_cluster.cc:1428] Setting key 72ce93183ccd6ef4e56833126336e722
I20260811 11:05:42.375124 2584 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43253
I20260811 11:05:42.375219 2584 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:42.375367 2584 heartbeater.cc:511] Master 127.25.227.62:43253 requested a full tablet report, sending...
I20260811 11:05:42.375705 2018 ts_manager.cc:194] Registered new tserver with Master: 195a5dfccfe84785bc8cec5b7e3ce746 (127.25.227.2:42617)
I20260811 11:05:42.375985 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43253
--builtin_ntp_servers=127.25.227.20:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 11:05:42.459997 2590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:42.460209 2590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:42.460232 2590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:42.461392 2590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:42.461432 2590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:42.461458 2590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:42.462891 2590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:42.463126 2590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:42.463429 2590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:42.468557 2604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.468578 2606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.468812 2603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:42.468734 2590 server_base.cc:1034] running on GCE node
I20260811 11:05:42.469056 2590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:42.469318 2590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:42.470465 2590 hybrid_clock.cc:648] HybridClock initialized: now 1786446342470448 us; error 34 us; skew 500 ppm
I20260811 11:05:42.471717 2590 webserver.cc:460] Webserver started at http://127.25.227.3:33825/ using document root <none> and password file <none>
I20260811 11:05:42.471992 2590 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:42.472039 2590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:42.472188 2590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:42.473371 2590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "076a75522547477289719647ac7ac27b"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "4c6edbc4dc53a91fbc5e11f512297dd1"
server_key_iv: "632f342ccde4be052b609269ac37bf24"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.473783 2590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "076a75522547477289719647ac7ac27b"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "4c6edbc4dc53a91fbc5e11f512297dd1"
server_key_iv: "632f342ccde4be052b609269ac37bf24"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.475091 2590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:42.475783 2616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.475960 2590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.476064 2590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "076a75522547477289719647ac7ac27b"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "4c6edbc4dc53a91fbc5e11f512297dd1"
server_key_iv: "632f342ccde4be052b609269ac37bf24"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.476147 2590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:42.479574 2590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:42.479861 2590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:42.480006 2590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:42.480213 2590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:42.480561 2590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:42.480628 2590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.480662 2590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:42.480690 2590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.486689 2590 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:34755
I20260811 11:05:42.486740 2820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:34755 every 8 connection(s)
I20260811 11:05:42.487048 2590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:42.490192 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.487763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:38833 (local address 127.25.227.62:43253)
0811 11:05:42.487833 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.487835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.488083 (+ 248us) server_negotiation.cc:407] Connection header received
0811 11:05:42.488596 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.488598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.488604 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.488696 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.489945 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.489946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.489947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.489953 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.489978 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.489983 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.490043 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.490112 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.490127 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:05:42.490324 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.487748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43253 (local address 127.25.227.3:38833)
0811 11:05:42.487944 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.487984 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.488461 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.488750 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.488758 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.488766 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.489789 (+ 1023us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.489790 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.489816 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.489843 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.490042 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.490044 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.490046 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.490097 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.490143 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260811 11:05:42.490833 2821 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43253
I20260811 11:05:42.490922 2821 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:42.491103 2821 heartbeater.cc:511] Master 127.25.227.62:43253 requested a full tablet report, sending...
I20260811 11:05:42.491537 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2590
I20260811 11:05:42.491567 2018 ts_manager.cc:194] Registered new tserver with Master: 076a75522547477289719647ac7ac27b (127.25.227.3:34755)
I20260811 11:05:42.491647 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:42.491858 26508 external_mini_cluster.cc:1428] Setting key 6644f1eef679833596743bdf380357fb
I20260811 11:05:42.492686 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:05:42.495128 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.494025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46926 (local address 127.25.227.62:43253)
0811 11:05:42.494100 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.494103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.494200 (+ 97us) server_negotiation.cc:407] Connection header received
0811 11:05:42.494295 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.494296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.494301 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.494354 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.494925 (+ 571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.494926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.494926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.494930 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.494943 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.494947 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.494993 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.495045 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.495059 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:05:42.496768 2018 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:42.498410 2018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:42.502744 2846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.501041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34755 (local address 127.0.0.1:49980)
0811 11:05:42.501227 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.501262 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.501325 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.501767 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.501768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.501771 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.502327 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.502327 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.502333 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.502341 (+ 8us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.502591 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.502592 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.502593 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.502645 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.502661 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":83,"threads_started":1}
I20260811 11:05:42.502823 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.500850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36562 (local address 127.25.227.2:42617)
0811 11:05:42.501068 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.501073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.501330 (+ 257us) server_negotiation.cc:407] Connection header received
0811 11:05:42.501475 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.501482 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.501492 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.501575 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.502289 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.502296 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.502297 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.502302 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.502340 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.502370 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.502431 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.502602 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.502621 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":116,"threads_started":1}
I20260811 11:05:42.502945 2840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.500787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:43249 (local address 127.0.0.1:44880)
0811 11:05:42.501225 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.501262 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.501358 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.502043 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.502044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.502046 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.502542 (+ 496us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.502542 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.502549 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.502560 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.502811 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.502812 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.502813 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.502859 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.502873 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":95,"threads_started":1}
I20260811 11:05:42.503050 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.500769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:42617 (local address 127.0.0.1:36562)
0811 11:05:42.501215 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.501256 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.501359 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.501601 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.501608 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.501615 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.502160 (+ 545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.502160 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.502177 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.502199 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.502476 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.502482 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.502484 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.502966 (+ 482us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.502979 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":66,"threads_started":1}
I20260811 11:05:42.503062 2847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.501127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.25.227.3:34755)
0811 11:05:42.501335 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.501340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.501352 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:05:42.501377 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.501380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.501389 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.501461 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.502408 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.502417 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.502418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.502423 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.502461 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.502484 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.502558 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.502960 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.502980 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":96,"threads_started":1}
I20260811 11:05:42.503209 2844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.500900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44880 (local address 127.25.227.1:43249)
0811 11:05:42.501137 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.501141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.501335 (+ 194us) server_negotiation.cc:407] Connection header received
0811 11:05:42.501916 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.501926 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.501937 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.502033 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.502644 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.502653 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.502654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.502659 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.502693 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.502722 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.502784 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.503088 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.503109 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":111,"threads_started":1}
I20260811 11:05:42.503793 2687 tablet_service.cc:1467] Processing CreateTablet for tablet 09ec2c0254154e8aa18d416dfa6c51dc (DEFAULT_TABLE table=test-table [id=c3753265c5a445118979fb0977a7457d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:42.503896 2233 tablet_service.cc:1467] Processing CreateTablet for tablet 09ec2c0254154e8aa18d416dfa6c51dc (DEFAULT_TABLE table=test-table [id=c3753265c5a445118979fb0977a7457d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:42.504207 2687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ec2c0254154e8aa18d416dfa6c51dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:42.504317 2233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ec2c0254154e8aa18d416dfa6c51dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:42.504938 2462 tablet_service.cc:1467] Processing CreateTablet for tablet 09ec2c0254154e8aa18d416dfa6c51dc (DEFAULT_TABLE table=test-table [id=c3753265c5a445118979fb0977a7457d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:42.505304 2462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09ec2c0254154e8aa18d416dfa6c51dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:42.507483 2848 tablet_bootstrap.cc:492] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: Bootstrap starting.
I20260811 11:05:42.507815 2849 tablet_bootstrap.cc:492] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Bootstrap starting.
I20260811 11:05:42.508282 2848 tablet_bootstrap.cc:654] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:42.508536 2849 tablet_bootstrap.cc:654] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:42.508656 2853 tablet_bootstrap.cc:492] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Bootstrap starting.
I20260811 11:05:42.508698 2848 log.cc:824] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:42.508883 2849 log.cc:824] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:42.509583 2853 tablet_bootstrap.cc:654] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:42.509661 2848 tablet_bootstrap.cc:492] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: No bootstrap required, opened a new log
I20260811 11:05:42.509740 2848 ts_tablet_manager.cc:1397] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:42.509837 2849 tablet_bootstrap.cc:492] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: No bootstrap required, opened a new log
I20260811 11:05:42.509915 2849 ts_tablet_manager.cc:1397] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:42.509953 2853 log.cc:824] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:42.510732 2853 tablet_bootstrap.cc:492] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: No bootstrap required, opened a new log
I20260811 11:05:42.510834 2853 ts_tablet_manager.cc:1397] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:42.512514 2848 raft_consensus.cc:348] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.512691 2848 raft_consensus.cc:374] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:42.512740 2848 raft_consensus.cc:729] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5ea3ac766a49d896aff2450b755cfb, State: Initialized, Role: FOLLOWER
I20260811 11:05:42.512655 2849 raft_consensus.cc:348] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.512909 2849 raft_consensus.cc:374] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:42.512877 2848 consensus_queue.cc:260] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.512987 2849 raft_consensus.cc:729] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 076a75522547477289719647ac7ac27b, State: Initialized, Role: FOLLOWER
I20260811 11:05:42.513154 2848 ts_tablet_manager.cc:1428] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 11:05:42.513242 2354 heartbeater.cc:503] Master 127.25.227.62:43253 was elected leader, sending a full tablet report...
I20260811 11:05:42.513159 2849 consensus_queue.cc:260] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.513332 2853 raft_consensus.cc:348] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.513500 2853 raft_consensus.cc:374] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:42.513512 2849 ts_tablet_manager.cc:1428] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 11:05:42.513561 2853 raft_consensus.cc:729] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 195a5dfccfe84785bc8cec5b7e3ce746, State: Initialized, Role: FOLLOWER
I20260811 11:05:42.513607 2821 heartbeater.cc:503] Master 127.25.227.62:43253 was elected leader, sending a full tablet report...
I20260811 11:05:42.513710 2853 consensus_queue.cc:260] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.513993 2853 ts_tablet_manager.cc:1428] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:05:42.514314 2584 heartbeater.cc:503] Master 127.25.227.62:43253 was elected leader, sending a full tablet report...
I20260811 11:05:42.596680 2859 raft_consensus.cc:482] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:42.596858 2859 raft_consensus.cc:504] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.597369 2859 leader_election.cc:288] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 195a5dfccfe84785bc8cec5b7e3ce746 (127.25.227.2:42617), 5c5ea3ac766a49d896aff2450b755cfb (127.25.227.1:43249)
I20260811 11:05:42.598896 2823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.597562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:42617 (local address 127.25.227.3:52437)
0811 11:05:42.597662 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.597676 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.597716 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.597941 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.597942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.597945 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.598479 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.598479 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.598488 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.598501 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.598721 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.598722 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.598723 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.598798 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.598812 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 11:05:42.598933 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.597738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:52437 (local address 127.25.227.2:42617)
0811 11:05:42.597788 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.597790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.597800 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:42.597836 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.597837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.597843 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.597919 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.598592 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.598593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.598594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.598598 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.598638 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.598644 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.598710 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.598809 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.598830 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 11:05:42.599033 2862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.597637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:43249 (local address 127.25.227.3:34805)
0811 11:05:42.597832 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.597840 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.597895 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.598052 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.598053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.598056 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:42.598673 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:05:42.598674 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:42.598681 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:05:42.598694 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:42.598878 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:42.598878 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:42.598879 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 11:05:42.598931 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:05:42.598944 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":128,"threads_started":1}
I20260811 11:05:42.599023 2844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.597709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:34805 (local address 127.25.227.1:43249)
0811 11:05:42.597772 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.597774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.597891 (+ 117us) server_negotiation.cc:407] Connection header received
0811 11:05:42.597960 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.597961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.597966 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.598031 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.598780 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.598782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.598783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.598788 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.598807 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.598812 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.598870 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.598929 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.598943 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 11:05:42.599305 2503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ec2c0254154e8aa18d416dfa6c51dc" candidate_uuid: "076a75522547477289719647ac7ac27b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" is_pre_election: true
I20260811 11:05:42.599421 2503 raft_consensus.cc:2454] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 076a75522547477289719647ac7ac27b in term 0.
I20260811 11:05:42.599685 2238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ec2c0254154e8aa18d416dfa6c51dc" candidate_uuid: "076a75522547477289719647ac7ac27b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5ea3ac766a49d896aff2450b755cfb" is_pre_election: true
I20260811 11:05:42.599833 2238 raft_consensus.cc:2454] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 076a75522547477289719647ac7ac27b in term 0.
I20260811 11:05:42.600091 2618 leader_election.cc:302] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 076a75522547477289719647ac7ac27b, 5c5ea3ac766a49d896aff2450b755cfb; no voters:
I20260811 11:05:42.600243 2859 raft_consensus.cc:2781] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:42.600301 2859 raft_consensus.cc:482] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:42.600324 2859 raft_consensus.cc:3037] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:42.601070 2859 raft_consensus.cc:504] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.601248 2859 leader_election.cc:288] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [CANDIDATE]: Term 1 election: Requested vote from peers 195a5dfccfe84785bc8cec5b7e3ce746 (127.25.227.2:42617), 5c5ea3ac766a49d896aff2450b755cfb (127.25.227.1:43249)
I20260811 11:05:42.601380 2503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ec2c0254154e8aa18d416dfa6c51dc" candidate_uuid: "076a75522547477289719647ac7ac27b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "195a5dfccfe84785bc8cec5b7e3ce746"
I20260811 11:05:42.601449 2238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09ec2c0254154e8aa18d416dfa6c51dc" candidate_uuid: "076a75522547477289719647ac7ac27b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5ea3ac766a49d896aff2450b755cfb"
I20260811 11:05:42.601442 2503 raft_consensus.cc:3037] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:42.601533 2238 raft_consensus.cc:3037] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:42.602201 2503 raft_consensus.cc:2454] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 076a75522547477289719647ac7ac27b in term 1.
I20260811 11:05:42.602231 2238 raft_consensus.cc:2454] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 076a75522547477289719647ac7ac27b in term 1.
I20260811 11:05:42.602360 2619 leader_election.cc:302] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 076a75522547477289719647ac7ac27b, 195a5dfccfe84785bc8cec5b7e3ce746; no voters:
I20260811 11:05:42.602485 2859 raft_consensus.cc:2781] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:42.602665 2859 raft_consensus.cc:686] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 1 LEADER]: Becoming Leader. State: Replica: 076a75522547477289719647ac7ac27b, State: Running, Role: LEADER
I20260811 11:05:42.602770 2859 consensus_queue.cc:237] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } }
I20260811 11:05:42.603626 2019 catalog_manager.cc:5495] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b reported cstate change: term changed from 0 to 1, leader changed from <none> to 076a75522547477289719647ac7ac27b (127.25.227.3). New cstate: current_term: 1 leader_uuid: "076a75522547477289719647ac7ac27b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "076a75522547477289719647ac7ac27b" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34755 } health_report { overall_health: HEALTHY } } }
I20260811 11:05:42.620304 2847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.619303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49982 (local address 127.25.227.3:34755)
0811 11:05:42.619362 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.619364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.619373 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:42.619444 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.619445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.619457 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.619505 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.620029 (+ 524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.620030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.620030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.620034 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.620050 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.620054 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.620099 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.620156 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.620185 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 11:05:42.621814 2587 tablet.cc:2369] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:42.622176 2503 raft_consensus.cc:1261] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 1 FOLLOWER]: Refusing update from remote peer 076a75522547477289719647ac7ac27b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:42.622180 2238 raft_consensus.cc:1261] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 1 FOLLOWER]: Refusing update from remote peer 076a75522547477289719647ac7ac27b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:42.622560 2859 consensus_queue.cc:1035] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c5ea3ac766a49d896aff2450b755cfb" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 43249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:42.622710 2868 consensus_queue.cc:1035] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [LEADER]: Connected to new peer: Peer: permanent_uuid: "195a5dfccfe84785bc8cec5b7e3ce746" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 42617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:42.625072 2875 mvcc.cc:205] Tried to move back new op lower bound from 7317284219377442816 to 7317284219301593088. Current Snapshot: MvccSnapshot[applied={T|T < 7317284219377442816}]
I20260811 11:05:42.625710 2876 mvcc.cc:205] Tried to move back new op lower bound from 7317284219377442816 to 7317284219301593088. Current Snapshot: MvccSnapshot[applied={T|T < 7317284219377442816}]
I20260811 11:05:42.627472 2877 mvcc.cc:205] Tried to move back new op lower bound from 7317284219377442816 to 7317284219301593088. Current Snapshot: MvccSnapshot[applied={T|T < 7317284219377442816 or (T in {7317284219377442816})}]
I20260811 11:05:42.627694 2017 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:42.627782 2017 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:42.628602 2017 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6210320f089d4be1b97e86644d2c783c: Sending DeleteTablet for 3 replicas of tablet 09ec2c0254154e8aa18d416dfa6c51dc
I20260811 11:05:42.628965 2233 tablet_service.cc:1514] Processing DeleteTablet for tablet 09ec2c0254154e8aa18d416dfa6c51dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:42 UTC) from {username='slave'} at 127.0.0.1:44880
I20260811 11:05:42.629007 2462 tablet_service.cc:1514] Processing DeleteTablet for tablet 09ec2c0254154e8aa18d416dfa6c51dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:42 UTC) from {username='slave'} at 127.0.0.1:36562
I20260811 11:05:42.629019 2687 tablet_service.cc:1514] Processing DeleteTablet for tablet 09ec2c0254154e8aa18d416dfa6c51dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:42 UTC) from {username='slave'} at 127.0.0.1:49980
I20260811 11:05:42.629254 2885 tablet_replica.cc:330] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb: stopping tablet replica
I20260811 11:05:42.629411 2885 raft_consensus.cc:2229] T 09ec2c0254154e8aa18d416dfa6c51dc P 5c5ea3ac766a49d896aff2450b755cfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:42.629441 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2131
I20260811 11:05:42.629254 2889 tablet_replica.cc:330] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: stopping tablet replica
I20260811 11:05:42.650260 2889 raft_consensus.cc:2229] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:42.650415 2889 raft_consensus.cc:2258] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:42.654970 2889 ts_tablet_manager.cc:1905] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:42.657099 2889 ts_tablet_manager.cc:1918] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:42.657249 2889 log.cc:1196] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/09ec2c0254154e8aa18d416dfa6c51dc
I20260811 11:05:42.657547 2889 ts_tablet_manager.cc:1939] T 09ec2c0254154e8aa18d416dfa6c51dc P 195a5dfccfe84785bc8cec5b7e3ce746: Deleting consensus metadata
I20260811 11:05:42.658072 2888 tablet_replica.cc:330] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: stopping tablet replica
I20260811 11:05:42.658161 1997 catalog_manager.cc:4841] TS 195a5dfccfe84785bc8cec5b7e3ce746 (127.25.227.2:42617): tablet 09ec2c0254154e8aa18d416dfa6c51dc (table test-table [id=c3753265c5a445118979fb0977a7457d]) successfully deleted
I20260811 11:05:42.658202 2888 raft_consensus.cc:2229] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:42.658354 2888 raft_consensus.cc:2258] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:42.658845 2888 ts_tablet_manager.cc:1905] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 11:05:42.660563 1996 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:43249 (error 108)
I20260811 11:05:42.660825 2888 ts_tablet_manager.cc:1918] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:42.660902 2888 log.cc:1196] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/09ec2c0254154e8aa18d416dfa6c51dc
I20260811 11:05:42.661221 2888 ts_tablet_manager.cc:1939] T 09ec2c0254154e8aa18d416dfa6c51dc P 076a75522547477289719647ac7ac27b: Deleting consensus metadata
I20260811 11:05:42.661445 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2361
I20260811 11:05:42.663695 1997 catalog_manager.cc:4841] TS 076a75522547477289719647ac7ac27b (127.25.227.3:34755): tablet 09ec2c0254154e8aa18d416dfa6c51dc (table test-table [id=c3753265c5a445118979fb0977a7457d]) successfully deleted
I20260811 11:05:42.663944 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.663809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:43249 (local address 127.0.0.1:44884)
0811 11:05:42.663853 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.663905 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:43249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 11:05:42.669617 1996 catalog_manager.cc:4584] TS 5c5ea3ac766a49d896aff2450b755cfb (127.25.227.1:43249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 09ec2c0254154e8aa18d416dfa6c51dc: Network error: Client connection negotiation failed: client connection to 127.25.227.1:43249: connect: Connection refused (error 111)
I20260811 11:05:42.670199 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2590
I20260811 11:05:42.685109 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1970
2026-08-11T11:05:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (729 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 11:05:42.709076 26508 mini_oidc.cc:152] Starting JWKS server
I20260811 11:05:42.710345 26508 webserver.cc:460] Webserver started at https://127.0.0.1:46445/ using document root <none> and password file <none>
I20260811 11:05:42.710476 26508 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 11:05:42.710675 26508 webserver.cc:460] Webserver started at http://127.0.0.1:43337/ using document root <none> and password file <none>
2026-08-11T11:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:42Z Disabled control of system clock
I20260811 11:05:42.720175 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42499
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:33081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:42499
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46445/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/testchainca.cert with env {}
W20260811 11:05:42.803740 2899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:42.803947 2899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:42.803968 2899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:42.805131 2899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:42.805212 2899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:42.805265 2899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:42.805285 2899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:42.805310 2899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:05:42.805337 2899 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:05:42.805359 2899 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46445/jwks.json
I20260811 11:05:42.806939 2899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:33081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:42499
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46445/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:42.807204 2899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:42.807431 2899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:42.812507 2913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:42.812470 2911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:42.812580 2899 server_base.cc:1034] running on GCE node
W20260811 11:05:42.812625 2910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:42.812978 2899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:42.813319 2899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:42.814500 2899 hybrid_clock.cc:648] HybridClock initialized: now 1786446342814484 us; error 31 us; skew 500 ppm
I20260811 11:05:42.816018 2899 webserver.cc:460] Webserver started at http://127.25.227.62:33881/ using document root <none> and password file <none>
I20260811 11:05:42.816298 2899 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:42.816349 2899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:42.816504 2899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:42.817667 2899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "6d6224350e82482ea6e1027eafe7bc55"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "22b5db9a7d2741769f46609b0ffc8f19"
server_key_iv: "e447286d06b37ee4346f68647d51b13b"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.818114 2899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "6d6224350e82482ea6e1027eafe7bc55"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "22b5db9a7d2741769f46609b0ffc8f19"
server_key_iv: "e447286d06b37ee4346f68647d51b13b"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.819795 2899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:05:42.820587 2925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:42.820843 2899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:42.820948 2899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "6d6224350e82482ea6e1027eafe7bc55"
format_stamp: "Formatted at 2026-08-11 11:05:42 on dist-test-slave-z8x9"
server_key: "22b5db9a7d2741769f46609b0ffc8f19"
server_key_iv: "e447286d06b37ee4346f68647d51b13b"
server_key_version: "encryptionkey@0"
I20260811 11:05:42.821034 2899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:42.841524 2899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:42.841845 2899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:42.842001 2899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:42.846174 2899 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:42499
I20260811 11:05:42.846210 3016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:42499 every 8 connection(s)
I20260811 11:05:42.846561 2899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:42.847568 3018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:42.849927 3018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55: Bootstrap starting.
I20260811 11:05:42.850528 3018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:42.850786 3018 log.cc:824] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:42.851424 3018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55: No bootstrap required, opened a new log
I20260811 11:05:42.852959 3018 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6224350e82482ea6e1027eafe7bc55" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42499 } }
I20260811 11:05:42.853096 3018 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:42.853118 3018 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6224350e82482ea6e1027eafe7bc55, State: Initialized, Role: FOLLOWER
I20260811 11:05:42.853287 3018 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6224350e82482ea6e1027eafe7bc55" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42499 } }
I20260811 11:05:42.853354 3018 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:42.853376 3018 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:42.853403 3018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:42.853917 3018 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6224350e82482ea6e1027eafe7bc55" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42499 } }
I20260811 11:05:42.854003 3018 leader_election.cc:302] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6224350e82482ea6e1027eafe7bc55; no voters:
I20260811 11:05:42.854127 3018 leader_election.cc:288] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:42.854202 3021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:42.854384 3021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6224350e82482ea6e1027eafe7bc55, State: Running, Role: LEADER
I20260811 11:05:42.854401 3018 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:42.854486 3021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6224350e82482ea6e1027eafe7bc55" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42499 } }
I20260811 11:05:42.855023 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2899
I20260811 11:05:42.855136 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:42.855188 3022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d6224350e82482ea6e1027eafe7bc55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6224350e82482ea6e1027eafe7bc55" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42499 } } }
I20260811 11:05:42.855218 3023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d6224350e82482ea6e1027eafe7bc55. Latest consensus state: current_term: 1 leader_uuid: "6d6224350e82482ea6e1027eafe7bc55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6224350e82482ea6e1027eafe7bc55" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42499 } } }
I20260811 11:05:42.855273 3022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:42.855276 3023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:42.855374 26508 external_mini_cluster.cc:1428] Setting key 089ff1b0570d6b5cb56c4ab125d6a533
I20260811 11:05:42.855867 3038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:42.856596 3038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:42.858273 3038 catalog_manager.cc:1347] Generated new cluster ID: 3a7065ca446449a7935e5d8b46492e1e
I20260811 11:05:42.858330 3038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:42.861459 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.855846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45282 (local address 127.25.227.62:42499)
0811 11:05:42.856274 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.856283 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.856320 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:05:42.857032 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.857038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.857093 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.857286 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:42.857520 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:42.858639 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:42.859453 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:42.859897 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:42.860042 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:42.860765 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:42.860769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:42.860769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:42.860944 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:42.860977 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:42.860988 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:42.861068 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:42.861142 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 11:05:42.861247 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":69,"threads_started":1}
I20260811 11:05:42.862407 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:05:42.880991 3038 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:42.881683 3038 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:42.883701 3038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d6224350e82482ea6e1027eafe7bc55: Generated new TSK 0
I20260811 11:05:42.883900 3038 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 11:05:42.917011 3067 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 11:05:42.917201 3067 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 11:05:42.917536 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:42.894225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45294 (local address 127.25.227.62:42499)
0811 11:05:42.894285 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:42.894287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:42.894377 (+ 90us) server_negotiation.cc:407] Connection header received
0811 11:05:42.894474 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:42.894475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:42.894486 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:42.894547 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:05:42.894723 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:42.895206 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:42.896317 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:42.896489 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:42.896538 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:42.896774 (+ 236us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:05:42.916987 (+ 20213us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46445/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 11:05:42.917463 (+ 476us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45294: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46445/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 11:05:42.917626 3050 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45294: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46445/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 11:05:42.917783 3065 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:42.894126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:42499 (local address 127.0.0.1:45294)
0811 11:05:42.894306 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:42.894317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:42.894384 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:42.894578 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:42.894579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:42.894581 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:05:42.894655 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:42.894657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:42.895286 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:42.895287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:42.896234 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:42.896236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:42.896571 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:42.896572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:42.896640 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:42.896664 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:05:42.917197 (+ 20533us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46445/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 11:05:42.917321 (+ 124us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.227.62:42499: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46445/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.25.227.62:42499: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46445/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 11:05:42.918318 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2899
2026-08-11T11:05:42Z chronyd exiting
I20260811 11:05:42.964785 26508 test_util.cc:175] -----------------------------------------------
I20260811 11:05:42.964874 26508 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786446315517896-26508-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (256 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 11:05:42.965840 26508 mini_oidc.cc:152] Starting JWKS server
I20260811 11:05:42.966548 26508 webserver.cc:460] Webserver started at https://127.0.0.1:33737/ using document root <none> and password file <none>
I20260811 11:05:42.966590 26508 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 11:05:42.966760 26508 webserver.cc:460] Webserver started at http://127.0.0.1:37459/ using document root <none> and password file <none>
2026-08-11T11:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:42Z Disabled control of system clock
I20260811 11:05:42.976295 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40205
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:42369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:40205
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33737/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/testchainca.cert with env {}
W20260811 11:05:43.059676 3077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:43.059885 3077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:43.059906 3077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:43.061092 3077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:43.061136 3077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:43.061149 3077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:43.061161 3077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:43.061220 3077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:05:43.061242 3077 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:05:43.061261 3077 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33737/jwks.json
I20260811 11:05:43.062726 3077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:40205
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33737/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:43.062922 3077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:43.063082 3077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:43.068089 3084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:43.068104 3089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:43.068104 3092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:43.068683 3077 server_base.cc:1034] running on GCE node
I20260811 11:05:43.069010 3077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:43.069350 3077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:43.070545 3077 hybrid_clock.cc:648] HybridClock initialized: now 1786446343070536 us; error 38 us; skew 500 ppm
I20260811 11:05:43.071774 3077 webserver.cc:460] Webserver started at http://127.25.227.62:42847/ using document root <none> and password file <none>
I20260811 11:05:43.072023 3077 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:43.072093 3077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:43.072229 3077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:43.073393 3077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "9f395ba2a2ba4bc391cc41f100b30650"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "8d64b25e6ac1524b4b0c3951abcf7fe8"
server_key_iv: "fa8a46f1ac10264890dba5fc3c14fbe6"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.073810 3077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "9f395ba2a2ba4bc391cc41f100b30650"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "8d64b25e6ac1524b4b0c3951abcf7fe8"
server_key_iv: "fa8a46f1ac10264890dba5fc3c14fbe6"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.075145 3077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:05:43.075856 3105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:43.076030 3077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:43.076140 3077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "9f395ba2a2ba4bc391cc41f100b30650"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "8d64b25e6ac1524b4b0c3951abcf7fe8"
server_key_iv: "fa8a46f1ac10264890dba5fc3c14fbe6"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.076215 3077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:43.091682 3077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:43.091992 3077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:43.092157 3077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:43.096333 3077 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:40205
I20260811 11:05:43.096385 3203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:40205 every 8 connection(s)
I20260811 11:05:43.096733 3077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:43.097533 3205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:43.100257 3205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650: Bootstrap starting.
I20260811 11:05:43.100873 3205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:43.101290 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 3077
I20260811 11:05:43.101292 3205 log.cc:824] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:43.101387 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:43.101590 26508 external_mini_cluster.cc:1428] Setting key a74e987440eb78616126137b81e555c2
I20260811 11:05:43.102080 3205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650: No bootstrap required, opened a new log
I20260811 11:05:43.104496 3205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f395ba2a2ba4bc391cc41f100b30650" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40205 } }
I20260811 11:05:43.104640 3205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:43.104664 3205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f395ba2a2ba4bc391cc41f100b30650, State: Initialized, Role: FOLLOWER
I20260811 11:05:43.104815 3205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f395ba2a2ba4bc391cc41f100b30650" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40205 } }
I20260811 11:05:43.104918 3205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:43.104969 3205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:43.105043 3205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:43.105676 3205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f395ba2a2ba4bc391cc41f100b30650" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40205 } }
I20260811 11:05:43.105810 3205 leader_election.cc:302] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f395ba2a2ba4bc391cc41f100b30650; no voters:
I20260811 11:05:43.106019 3205 leader_election.cc:288] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:43.106045 3212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:43.106164 3212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [term 1 LEADER]: Becoming Leader. State: Replica: 9f395ba2a2ba4bc391cc41f100b30650, State: Running, Role: LEADER
I20260811 11:05:43.106261 3212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f395ba2a2ba4bc391cc41f100b30650" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40205 } }
I20260811 11:05:43.106312 3205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:43.106593 3213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f395ba2a2ba4bc391cc41f100b30650. Latest consensus state: current_term: 1 leader_uuid: "9f395ba2a2ba4bc391cc41f100b30650" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f395ba2a2ba4bc391cc41f100b30650" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40205 } } }
I20260811 11:05:43.106853 3213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:43.106781 3215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f395ba2a2ba4bc391cc41f100b30650" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f395ba2a2ba4bc391cc41f100b30650" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40205 } } }
I20260811 11:05:43.107125 3215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:43.107302 3227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:43.108206 3211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:43.102107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38380 (local address 127.25.227.62:40205)
0811 11:05:43.102318 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:43.102327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:43.102358 (+ 31us) server_negotiation.cc:407] Connection header received
0811 11:05:43.103278 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:43.103286 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:43.103347 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:43.103512 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:43.103746 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.104755 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.105729 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.106366 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.106853 (+ 487us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.107303 (+ 450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:43.107307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:43.107307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:43.107508 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:43.107552 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:43.107568 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:43.107636 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:43.107896 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 11:05:43.107981 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260811 11:05:43.108508 3227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:43.109624 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:05:43.110189 3227 catalog_manager.cc:1347] Generated new cluster ID: 2207e50c047849cb8d114aaaf198ce09
I20260811 11:05:43.110242 3227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:43.126942 3227 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:43.127468 3227 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:43.131099 3227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f395ba2a2ba4bc391cc41f100b30650: Generated new TSK 0
I20260811 11:05:43.131331 3227 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 11:05:43.162213 3250 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 11:05:43.162317 3250 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 11:05:43.162712 3211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:43.140646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38392 (local address 127.25.227.62:40205)
0811 11:05:43.140719 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:43.140721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:43.140838 (+ 117us) server_negotiation.cc:407] Connection header received
0811 11:05:43.140919 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:43.140920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:43.140933 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:43.141000 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:05:43.141148 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.141686 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.142475 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.142702 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.142778 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.142972 (+ 194us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:05:43.162457 (+ 19485us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33737/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 11:05:43.162631 (+ 174us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33737/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 11:05:43.162782 3211 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33737/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 11:05:43.162817 3249 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:43.140565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40205 (local address 127.0.0.1:38392)
0811 11:05:43.140777 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:43.140785 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:43.140856 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:43.141003 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:43.141004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:43.141006 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:05:43.141065 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:43.141067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.141777 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.141779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:43.142383 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:43.142386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.142782 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.142783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:43.142843 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.142847 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:05:43.162578 (+ 19731us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33737/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 11:05:43.162689 (+ 111us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.227.62:40205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33737/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":120,"threads_started":1}
I20260811 11:05:43.163170 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 3077
2026-08-11T11:05:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (246 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 11:05:43.211653 26508 mini_oidc.cc:152] Starting JWKS server
I20260811 11:05:43.212328 26508 webserver.cc:460] Webserver started at https://127.0.0.1:37925/ using document root <none> and password file <none>
I20260811 11:05:43.212370 26508 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 11:05:43.212510 26508 webserver.cc:460] Webserver started at http://127.0.0.1:42875/ using document root <none> and password file <none>
2026-08-11T11:05:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:43Z Disabled control of system clock
I20260811 11:05:43.221817 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41653
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:33129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41653
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37925/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 11:05:43.304948 3273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:43.305150 3273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:43.305194 3273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:43.306380 3273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:43.306423 3273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:43.306437 3273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:43.306448 3273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:43.306460 3273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:05:43.306473 3273 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:05:43.306484 3273 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37925/jwks.json
I20260811 11:05:43.307876 3273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:33129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37925/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:43.308076 3273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:43.308312 3273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:43.313257 3282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:43.313262 3284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:43.313426 3273 server_base.cc:1034] running on GCE node
W20260811 11:05:43.313269 3286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:43.313823 3273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:43.314152 3273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:43.315303 3273 hybrid_clock.cc:648] HybridClock initialized: now 1786446343315279 us; error 37 us; skew 500 ppm
I20260811 11:05:43.316624 3273 webserver.cc:460] Webserver started at http://127.25.227.62:33067/ using document root <none> and password file <none>
I20260811 11:05:43.316895 3273 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:43.316942 3273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:43.317101 3273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:43.318228 3273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "74ca249e4fdb40d6a56cb4834417c658"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "4774829d7d9c6220290bd04003a6621f"
server_key_iv: "d07fec00c5c6ba711ca7bb2e595d8e93"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.318609 3273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "74ca249e4fdb40d6a56cb4834417c658"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "4774829d7d9c6220290bd04003a6621f"
server_key_iv: "d07fec00c5c6ba711ca7bb2e595d8e93"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.320075 3273 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:43.320784 3299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:43.320982 3273 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:43.321071 3273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "74ca249e4fdb40d6a56cb4834417c658"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "4774829d7d9c6220290bd04003a6621f"
server_key_iv: "d07fec00c5c6ba711ca7bb2e595d8e93"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.321127 3273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:43.334233 3273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:43.334517 3273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:43.334621 3273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:43.338596 3273 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:41653
I20260811 11:05:43.338629 3387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:41653 every 8 connection(s)
I20260811 11:05:43.339020 3273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:43.339766 3388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:43.342517 3388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658: Bootstrap starting.
I20260811 11:05:43.343182 3388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:43.343509 3388 log.cc:824] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:43.344228 3388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658: No bootstrap required, opened a new log
I20260811 11:05:43.345940 3388 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ca249e4fdb40d6a56cb4834417c658" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41653 } }
I20260811 11:05:43.346107 3388 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:43.346156 3388 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ca249e4fdb40d6a56cb4834417c658, State: Initialized, Role: FOLLOWER
I20260811 11:05:43.346338 3388 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ca249e4fdb40d6a56cb4834417c658" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41653 } }
I20260811 11:05:43.346442 3388 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:43.346426 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 3273
I20260811 11:05:43.346477 3388 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:43.346524 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:43.346530 3388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:43.346743 26508 external_mini_cluster.cc:1428] Setting key 6d5ea8b757b6480a0321fa6a298c4835
I20260811 11:05:43.347235 3388 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ca249e4fdb40d6a56cb4834417c658" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41653 } }
I20260811 11:05:43.347359 3388 leader_election.cc:302] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74ca249e4fdb40d6a56cb4834417c658; no voters:
I20260811 11:05:43.347532 3388 leader_election.cc:288] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:43.347599 3394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:43.347780 3394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [term 1 LEADER]: Becoming Leader. State: Replica: 74ca249e4fdb40d6a56cb4834417c658, State: Running, Role: LEADER
I20260811 11:05:43.347790 3388 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:43.347908 3394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ca249e4fdb40d6a56cb4834417c658" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41653 } }
I20260811 11:05:43.348255 3394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74ca249e4fdb40d6a56cb4834417c658. Latest consensus state: current_term: 1 leader_uuid: "74ca249e4fdb40d6a56cb4834417c658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ca249e4fdb40d6a56cb4834417c658" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41653 } } }
I20260811 11:05:43.348363 3394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:43.348255 3398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74ca249e4fdb40d6a56cb4834417c658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ca249e4fdb40d6a56cb4834417c658" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41653 } } }
I20260811 11:05:43.348537 3398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:43.348682 3407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:43.349246 3407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:43.351187 3407 catalog_manager.cc:1347] Generated new cluster ID: 1464e5c6939747feaa193e7d761bc35a
I20260811 11:05:43.351255 3407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:43.353566 3393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:43.347274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40378 (local address 127.25.227.62:41653)
0811 11:05:43.347501 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:43.347510 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:43.347547 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:05:43.347721 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:43.347729 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:43.347813 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:43.348246 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:43.348358 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.350261 (+ 1903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.351345 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.351940 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.352059 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.352823 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:43.352827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:43.352828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:43.353034 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:43.353079 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:43.353093 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:43.353158 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:43.353286 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 11:05:43.353363 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260811 11:05:43.354525 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:05:43.367640 3407 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:43.368350 3407 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:43.373492 3407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74ca249e4fdb40d6a56cb4834417c658: Generated new TSK 0
I20260811 11:05:43.373675 3407 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:05:43.389638 3393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:43.385778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40384 (local address 127.25.227.62:41653)
0811 11:05:43.385842 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:43.385844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:43.385943 (+ 99us) server_negotiation.cc:407] Connection header received
0811 11:05:43.386000 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:43.386002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:43.386015 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:43.386096 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:05:43.386224 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.387035 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.387816 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.388160 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.388233 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.388402 (+ 169us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:05:43.389418 (+ 1016us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37925/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 11:05:43.389562 (+ 144us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37925/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 11:05:43.389704 3393 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37925/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 11:05:43.391527 3437 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:43.385683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41653 (local address 127.0.0.1:40384)
0811 11:05:43.385865 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:43.385875 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:43.385940 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:43.386102 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:43.386103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:43.386105 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:05:43.386155 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:43.386157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.387126 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.387127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:43.387729 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:43.387731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.388246 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.388247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:43.388293 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.388298 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:05:43.389518 (+ 1220us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37925/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 11:05:43.391432 (+ 1914us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.227.62:41653: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37925/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":1693,"thread_start_us":115,"threads_started":1}
I20260811 11:05:43.391917 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 3273
E20260811 11:05:43.406121 3438 webserver.cc:533] Webserver: sslize failed:
E20260811 11:05:43.406193 3438 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T11:05:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (225 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T11:05:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:43Z Disabled control of system clock
I20260811 11:05:43.448203 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:34155
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:35429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:34155
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/testchainca.cert with env {}
W20260811 11:05:43.530325 3444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:43.530534 3444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:43.530556 3444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:43.531744 3444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:43.531795 3444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:43.531807 3444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:43.531821 3444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:43.531877 3444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 11:05:43.531895 3444 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 11:05:43.531921 3444 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 11:05:43.533419 3444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:35429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:34155
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:34155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:43.533679 3444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:43.533903 3444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:43.538841 3452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:43.538821 3455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:43.538842 3453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:43.539186 3444 server_base.cc:1034] running on GCE node
I20260811 11:05:43.539477 3444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:43.539714 3444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:43.540881 3444 hybrid_clock.cc:648] HybridClock initialized: now 1786446343540868 us; error 32 us; skew 500 ppm
I20260811 11:05:43.542297 3444 webserver.cc:460] Webserver started at http://127.25.227.62:38707/ using document root <none> and password file <none>
I20260811 11:05:43.542574 3444 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:43.542623 3444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:43.542800 3444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:43.543846 3444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "7e2ee640dfde495d88d7d770d8a72bd2"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "abd71a7ec3e2416aa426e28e8c88fbac"
server_key_iv: "0ac1f91f66ec2ea24a0ef4c0f8de764e"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.544226 3444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "7e2ee640dfde495d88d7d770d8a72bd2"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "abd71a7ec3e2416aa426e28e8c88fbac"
server_key_iv: "0ac1f91f66ec2ea24a0ef4c0f8de764e"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.545855 3444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:43.546653 3470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:43.546834 3444 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:43.546929 3444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "7e2ee640dfde495d88d7d770d8a72bd2"
format_stamp: "Formatted at 2026-08-11 11:05:43 on dist-test-slave-z8x9"
server_key: "abd71a7ec3e2416aa426e28e8c88fbac"
server_key_iv: "0ac1f91f66ec2ea24a0ef4c0f8de764e"
server_key_version: "encryptionkey@0"
I20260811 11:05:43.547005 3444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:43.567022 3444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:43.567390 3444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:43.567565 3444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:43.571666 3444 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:34155
I20260811 11:05:43.571748 3567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:34155 every 8 connection(s)
I20260811 11:05:43.572098 3444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:43.572839 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 3444
I20260811 11:05:43.572930 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:43.573136 26508 external_mini_cluster.cc:1428] Setting key 81fd3054e9c86b408e0cc8a4a6a2d186
I20260811 11:05:43.573262 3568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:43.576042 3568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2: Bootstrap starting.
I20260811 11:05:43.576722 3568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:43.577020 3568 log.cc:824] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:43.577962 3568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2: No bootstrap required, opened a new log
I20260811 11:05:43.578884 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:43.573740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41476 (local address 127.25.227.62:34155)
0811 11:05:43.573994 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:43.574002 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:43.574028 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:05:43.574630 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:43.574637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:43.574701 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:43.574856 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:43.575074 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.575937 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.576784 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.577336 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.577476 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.578248 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:43.578252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:43.578253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:05:43.578414 (+ 161us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:43.578447 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:05:43.578458 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:43.578544 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:43.578622 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 11:05:43.578704 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":88,"threads_started":1}
I20260811 11:05:43.580070 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:05:43.580265 3568 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34155 } }
I20260811 11:05:43.580422 3568 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:43.580467 3568 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2ee640dfde495d88d7d770d8a72bd2, State: Initialized, Role: FOLLOWER
I20260811 11:05:43.580583 3568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34155 } }
I20260811 11:05:43.580677 3568 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:43.580719 3568 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:43.580777 3568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:43.581425 3568 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34155 } }
I20260811 11:05:43.581516 3568 leader_election.cc:302] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e2ee640dfde495d88d7d770d8a72bd2; no voters:
I20260811 11:05:43.581699 3568 leader_election.cc:288] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:43.581791 3575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:43.581949 3575 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2ee640dfde495d88d7d770d8a72bd2, State: Running, Role: LEADER
I20260811 11:05:43.581951 3568 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:43.582047 3575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34155 } }
I20260811 11:05:43.582501 3576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34155 } } }
I20260811 11:05:43.582598 3576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:43.583035 3580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e2ee640dfde495d88d7d770d8a72bd2. Latest consensus state: current_term: 1 leader_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e2ee640dfde495d88d7d770d8a72bd2" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34155 } } }
I20260811 11:05:43.583109 3580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:43.583225 3588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:43.583696 3588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:43.585282 3588 catalog_manager.cc:1347] Generated new cluster ID: b85070052af54b078ada04de0a49b2e3
I20260811 11:05:43.585338 3588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:43.591488 3588 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:43.591969 3588 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:43.598660 3588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e2ee640dfde495d88d7d770d8a72bd2: Generated new TSK 0
I20260811 11:05:43.598838 3588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:05:44.465986 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:43.605691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41482 (local address 127.25.227.62:34155)
0811 11:05:43.605752 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:43.605765 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:43.605869 (+ 104us) server_negotiation.cc:407] Connection header received
0811 11:05:43.605942 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:43.605943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:43.605955 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:43.606012 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0811 11:05:43.606162 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.606644 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.607792 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.607983 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.608032 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.608221 (+ 189us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 11:05:44.465738 (+857517us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 11:05:44.465918 (+ 180us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41482: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 11:05:44.466087 3572 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41482: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 11:05:44.466111 3620 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:43.605642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34155 (local address 127.0.0.1:41482)
0811 11:05:43.605798 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:43.605809 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:43.605876 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:43.606036 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:43.606037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:43.606039 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 11:05:43.606102 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:43.606104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.606738 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.606739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:43.607707 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:43.607710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:43.608061 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:43.608062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:43.608127 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:43.608132 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 11:05:44.465899 (+857767us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 11:05:44.466033 (+ 134us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.25.227.62:34155: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260811 11:05:44.466526 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 3444
2026-08-11T11:05:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1056 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (94 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (95 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:44 dist-test-slave-z8x9 krb5kdc[3642](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:44 dist-test-slave-z8x9 krb5kdc[3642](info): set up 2 sockets
Aug 11 11:05:44 dist-test-slave-z8x9 krb5kdc[3642](info): commencing operation
krb5kdc: starting...
W20260811 11:05:45.962075 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:46.088404 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40165
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:40165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:46.173503 3660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:46.173728 3660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:46.173753 3660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:46.174897 3660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:46.174934 3660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:46.174949 3660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:46.174961 3660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:46.174979 3660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:46.176388 3660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:40165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:46.176589 3660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:46.176770 3660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:46.181911 3669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.181942 3671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.181915 3675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:46.182231 3660 server_base.cc:1034] running on GCE node
I20260811 11:05:46.182487 3660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:46.182791 3660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:46.183949 3660 hybrid_clock.cc:648] HybridClock initialized: now 1786446346183931 us; error 34 us; skew 500 ppm
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.186679 3660 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:46.187150 3660 webserver.cc:460] Webserver started at http://127.25.227.62:34945/ using document root <none> and password file <none>
I20260811 11:05:46.187388 3660 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:46.187459 3660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:46.187620 3660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:46.188735 3660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "94f1a5efc3654f738611f15daeacc42b"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "3a1386581c7db544c52a8410e5989236"
server_key_iv: "eb70912c39492ca586f787d35dd86c71"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.189224 3660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "94f1a5efc3654f738611f15daeacc42b"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "3a1386581c7db544c52a8410e5989236"
server_key_iv: "eb70912c39492ca586f787d35dd86c71"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.190783 3660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:46.191558 3686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.191763 3660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:46.191867 3660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "94f1a5efc3654f738611f15daeacc42b"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "3a1386581c7db544c52a8410e5989236"
server_key_iv: "eb70912c39492ca586f787d35dd86c71"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.191952 3660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:46.215874 3660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:46.218179 3660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:46.218355 3660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:46.222565 3660 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:40165
I20260811 11:05:46.222611 3771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:40165 every 8 connection(s)
I20260811 11:05:46.223058 3660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:46.223989 3772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:46.224145 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 3660
I20260811 11:05:46.224318 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:46.224519 26508 external_mini_cluster.cc:1428] Setting key 1039ac7236579f6eef00ae3acfb2b81c
I20260811 11:05:46.227762 3772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b: Bootstrap starting.
I20260811 11:05:46.228549 3772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:46.228883 3772 log.cc:824] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:46.229872 3772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b: No bootstrap required, opened a new log
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:46.232975 3772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f1a5efc3654f738611f15daeacc42b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40165 } }
I20260811 11:05:46.233222 3772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:46.233291 3772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f1a5efc3654f738611f15daeacc42b, State: Initialized, Role: FOLLOWER
I20260811 11:05:46.233441 3772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f1a5efc3654f738611f15daeacc42b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40165 } }
I20260811 11:05:46.233577 3772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:46.233632 3772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:46.233685 3772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:46.234472 3772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f1a5efc3654f738611f15daeacc42b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40165 } }
I20260811 11:05:46.234586 3772 leader_election.cc:302] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94f1a5efc3654f738611f15daeacc42b; no voters:
I20260811 11:05:46.234759 3772 leader_election.cc:288] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:46.234817 3780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:46.234963 3780 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [term 1 LEADER]: Becoming Leader. State: Replica: 94f1a5efc3654f738611f15daeacc42b, State: Running, Role: LEADER
I20260811 11:05:46.235054 3772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:46.235062 3780 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f1a5efc3654f738611f15daeacc42b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40165 } }
I20260811 11:05:46.235554 3782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94f1a5efc3654f738611f15daeacc42b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f1a5efc3654f738611f15daeacc42b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40165 } } }
I20260811 11:05:46.235570 3783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94f1a5efc3654f738611f15daeacc42b. Latest consensus state: current_term: 1 leader_uuid: "94f1a5efc3654f738611f15daeacc42b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f1a5efc3654f738611f15daeacc42b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40165 } } }
I20260811 11:05:46.235749 3783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:46.235716 3782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b [sys.catalog]: This master's current role is: LEADER
W20260811 11:05:46.241592 3803 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:05:46.241659 3803 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:05:46.242177 3793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:46.242389 3793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:46.243774 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.225147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38608 (local address 127.25.227.62:40165)
0811 11:05:46.225387 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.225397 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.225435 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:05:46.225948 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.225958 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.226026 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.226185 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.226832 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.228249 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.229465 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.230155 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.230288 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.238499 (+ 8211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.238504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.238505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.238519 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.240547 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.242090 (+ 1543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.242094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.242095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.242210 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.242450 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.242451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.242451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.242784 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.242919 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.243409 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.243557 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":96,"threads_started":1}
I20260811 11:05:46.244625 3793 catalog_manager.cc:1347] Generated new cluster ID: 77316a0f1f8e4fc49f46de8b8abf35dc
I20260811 11:05:46.244685 3793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:46.256054 3793 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:46.256553 3793 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:46.264250 3793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94f1a5efc3654f738611f15daeacc42b: Generated new TSK 0
I20260811 11:05:46.264434 3793 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:46.299665 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40165
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:46.404894 3815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:46.405097 3815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:46.405121 3815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:46.406284 3815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:46.406330 3815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:46.406358 3815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:46.407876 3815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:46.408129 3815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:46.408363 3815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:46.413489 3823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.413486 3824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.413506 3828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:46.414049 3815 server_base.cc:1034] running on GCE node
I20260811 11:05:46.414259 3815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:46.414534 3815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:46.415680 3815 hybrid_clock.cc:648] HybridClock initialized: now 1786446346415650 us; error 46 us; skew 500 ppm
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.418488 3815 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:46.418994 3815 webserver.cc:460] Webserver started at http://127.25.227.1:38151/ using document root <none> and password file <none>
I20260811 11:05:46.419238 3815 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:46.419312 3815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:46.419468 3815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:46.420528 3815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "cc4978ee8fa84557806c6e6761939f15"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "627e1372d45990b88ea29fe0c942268b"
server_key_iv: "a61226aae7368691edaf395a5a4a47f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.420918 3815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "cc4978ee8fa84557806c6e6761939f15"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "627e1372d45990b88ea29fe0c942268b"
server_key_iv: "a61226aae7368691edaf395a5a4a47f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.422377 3815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:46.423199 3838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.423504 3815 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:46.423615 3815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "cc4978ee8fa84557806c6e6761939f15"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "627e1372d45990b88ea29fe0c942268b"
server_key_iv: "a61226aae7368691edaf395a5a4a47f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.423691 3815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:46.453497 3815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:46.455544 3815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:46.455718 3815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:46.455989 3815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:46.456336 3815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:46.456401 3815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.456439 3815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:46.456486 3815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.462491 3815 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:38313
I20260811 11:05:46.462545 4054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:38313 every 8 connection(s)
I20260811 11:05:46.462911 3815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:46.466364 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 3815
I20260811 11:05:46.466499 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:46.466704 26508 external_mini_cluster.cc:1428] Setting key 48543958fe73ba92a488b5cae3680ca1
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:46.473116 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.463714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:52359 (local address 127.25.227.62:40165)
0811 11:05:46.463782 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.463785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.464011 (+ 226us) server_negotiation.cc:407] Connection header received
0811 11:05:46.464986 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.464988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.465001 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.465055 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.465726 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.466241 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.467466 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.467693 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.467767 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.470161 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.470163 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.470163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.470172 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.471684 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.472103 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.472104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.472105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.472174 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.472436 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.472437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.472438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.472563 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.472635 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.472929 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.473024 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:46.473296 4059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.463707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40165 (local address 127.25.227.1:52359)
0811 11:05:46.463882 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:46.463920 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:46.464872 (+ 952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:46.465138 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:46.465142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:46.465435 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:46.465625 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:46.465629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.466343 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.466344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:46.467341 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:46.467344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.467788 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.467790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:46.467921 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.468469 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:46.468478 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:46.470063 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:46.471773 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:46.471782 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:46.471784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:46.472023 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:46.472244 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:46.472245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:46.472245 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:46.472361 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:46.472638 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:46.472645 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:46.472782 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 11:05:46.472891 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 11:05:46.473050 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260811 11:05:46.473798 4055 heartbeater.cc:347] Connected to a master server at 127.25.227.62:40165
I20260811 11:05:46.473912 4055 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:46.474086 4055 heartbeater.cc:511] Master 127.25.227.62:40165 requested a full tablet report, sending...
I20260811 11:05:46.474622 3710 ts_manager.cc:194] Registered new tserver with Master: cc4978ee8fa84557806c6e6761939f15 (127.25.227.1:38313)
I20260811 11:05:46.475232 3710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:52359
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:46.494251 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40165
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:46.578794 4064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:46.579044 4064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:46.579069 4064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:46.580199 4064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:46.580237 4064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:46.580263 4064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:46.581751 4064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:46.581940 4064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:46.582123 4064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:46.587430 4071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.587502 4079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:46.587520 4064 server_base.cc:1034] running on GCE node
W20260811 11:05:46.587435 4074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:46.587941 4064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:46.588184 4064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:46.589339 4064 hybrid_clock.cc:648] HybridClock initialized: now 1786446346589312 us; error 38 us; skew 500 ppm
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.592154 4064 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:46.592658 4064 webserver.cc:460] Webserver started at http://127.25.227.2:40963/ using document root <none> and password file <none>
I20260811 11:05:46.592859 4064 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:46.592901 4064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:46.592998 4064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:46.594125 4064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "000597ba6cf140559d2f31860a800f9b"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "bfcbf4f72752c566c3e4440a2ba0c740"
server_key_iv: "e61bc74c84ebd9a6feb64e9f73a6999f"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.594600 4064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "000597ba6cf140559d2f31860a800f9b"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "bfcbf4f72752c566c3e4440a2ba0c740"
server_key_iv: "e61bc74c84ebd9a6feb64e9f73a6999f"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.596298 4064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:46.597074 4096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.597375 4064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:46.597462 4064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "000597ba6cf140559d2f31860a800f9b"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "bfcbf4f72752c566c3e4440a2ba0c740"
server_key_iv: "e61bc74c84ebd9a6feb64e9f73a6999f"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.597522 4064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:46.614549 4064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:46.616859 4064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:46.616966 4064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:46.617151 4064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:46.617509 4064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:46.617543 4064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.617565 4064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:46.617578 4064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.623484 4064 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:32841
I20260811 11:05:46.623531 4315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:32841 every 8 connection(s)
I20260811 11:05:46.623857 4064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:46.629679 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 4064
I20260811 11:05:46.629778 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:46.629947 26508 external_mini_cluster.cc:1428] Setting key 95e1dedd0d78ef4ce9ce6e20018aed6a
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:46.634275 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.624613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:59983 (local address 127.25.227.62:40165)
0811 11:05:46.624686 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.624689 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.624917 (+ 228us) server_negotiation.cc:407] Connection header received
0811 11:05:46.625914 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.625916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.625927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.625984 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.626763 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.627309 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.628340 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.628530 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.628595 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.630968 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.630970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.630970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.630979 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.632640 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.633269 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.633270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.633270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.633332 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.633633 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.633634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.633634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.633750 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.633802 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.634130 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.634209 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:05:46.634567 4319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.624593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40165 (local address 127.25.227.2:59983)
0811 11:05:46.624795 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:46.624833 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:46.625810 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:46.626036 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:46.626039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:46.626299 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:46.626669 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:46.626674 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.627410 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.627411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:46.628258 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:46.628260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.628612 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.628613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:46.628713 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.629256 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:46.629265 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:46.630874 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:46.632771 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:46.632779 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:46.632782 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:46.633126 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:46.633405 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:46.633406 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:46.633407 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:46.633562 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:46.633816 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:46.633823 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:46.633988 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 11:05:46.634109 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 11:05:46.634298 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":102,"threads_started":1}
I20260811 11:05:46.635181 4316 heartbeater.cc:347] Connected to a master server at 127.25.227.62:40165
I20260811 11:05:46.635291 4316 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:46.635494 4316 heartbeater.cc:511] Master 127.25.227.62:40165 requested a full tablet report, sending...
I20260811 11:05:46.635999 3710 ts_manager.cc:194] Registered new tserver with Master: 000597ba6cf140559d2f31860a800f9b (127.25.227.2:32841)
I20260811 11:05:46.636495 3710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:59983
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:46.658366 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40165
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:46.745981 4322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:46.746215 4322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:46.746255 4322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:46.747397 4322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:46.747465 4322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:46.747509 4322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:46.748993 4322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:40165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:46.749285 4322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:46.749542 4322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:46.754566 4337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.754619 4331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:46.754575 4329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:46.754844 4322 server_base.cc:1034] running on GCE node
I20260811 11:05:46.755043 4322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:46.755331 4322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:46.756500 4322 hybrid_clock.cc:648] HybridClock initialized: now 1786446346756487 us; error 30 us; skew 500 ppm
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.759006 4322 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:46.759464 4322 webserver.cc:460] Webserver started at http://127.25.227.3:42403/ using document root <none> and password file <none>
I20260811 11:05:46.759724 4322 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:46.759778 4322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:46.759943 4322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:46.760993 4322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "902bca944d8e49b387d57eb4b73cb05d"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "c50f6687aff23a054e03d8aee89294ce"
server_key_iv: "4cdfe2fc461c485da9ebe275d3cd94fe"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.761413 4322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "902bca944d8e49b387d57eb4b73cb05d"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "c50f6687aff23a054e03d8aee89294ce"
server_key_iv: "4cdfe2fc461c485da9ebe275d3cd94fe"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.762897 4322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:46.763729 4347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.763995 4322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:46.764101 4322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "902bca944d8e49b387d57eb4b73cb05d"
format_stamp: "Formatted at 2026-08-11 11:05:46 on dist-test-slave-z8x9"
server_key: "c50f6687aff23a054e03d8aee89294ce"
server_key_iv: "4cdfe2fc461c485da9ebe275d3cd94fe"
server_key_version: "encryptionkey@0"
I20260811 11:05:46.764184 4322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:46.780714 4322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:46.782936 4322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:46.783109 4322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:46.783401 4322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:46.783792 4322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:46.783849 4322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.783891 4322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:46.783921 4322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:46.790158 4322 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:45789
I20260811 11:05:46.790305 4565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:45789 every 8 connection(s)
I20260811 11:05:46.790555 4322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:46.796871 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 4322
I20260811 11:05:46.796975 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:46.797150 26508 external_mini_cluster.cc:1428] Setting key ef254cad85d8102f6429f284c2b8bee4
I20260811 11:05:46.800343 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.791259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:41413 (local address 127.25.227.62:40165)
0811 11:05:46.791323 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.791325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.791491 (+ 166us) server_negotiation.cc:407] Connection header received
0811 11:05:46.792439 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.792440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.792451 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.792510 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.793144 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.793698 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.794682 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.794918 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.795027 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.797288 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.797290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.797290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.797298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.798883 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.799297 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.799299 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.799300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.799367 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.799634 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.799635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.799635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.799758 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.799828 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.800153 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.800248 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:05:46.800552 4568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.791206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:40165 (local address 127.25.227.3:41413)
0811 11:05:46.791374 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:46.791416 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:46.792350 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:46.792590 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:46.792593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:46.792860 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:46.793072 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:46.793076 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.793795 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.793796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:46.794602 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:46.794604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.795058 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.795059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:46.795166 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.795648 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:46.795656 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:46.797110 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:46.798966 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:46.798974 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:46.798976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:46.799214 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:46.799435 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:46.799436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:46.799437 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:46.799557 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:46.799831 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:46.799838 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:46.799978 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 11:05:46.800085 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 11:05:46.800312 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260811 11:05:46.801011 4566 heartbeater.cc:347] Connected to a master server at 127.25.227.62:40165
I20260811 11:05:46.801096 4566 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:46.801324 4566 heartbeater.cc:511] Master 127.25.227.62:40165 requested a full tablet report, sending...
I20260811 11:05:46.801761 3710 ts_manager.cc:194] Registered new tserver with Master: 902bca944d8e49b387d57eb4b73cb05d (127.25.227.3:45789)
I20260811 11:05:46.802094 3710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:41413
I20260811 11:05:46.809399 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/test-admin.keytab.
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.825865 26508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 11:05:46.827914 4576 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:46.826907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.25.227.1:38313)
0811 11:05:46.827108 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.827113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.827124 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:05:46.827175 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.827178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.827198 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.827291 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.827810 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35600: BlockingRecv error: recv got EOF from 127.0.0.1:35600 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":114,"threads_started":1}
W20260811 11:05:46.827953 26508 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc)
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.828985 26508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.830046 26508 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:46.838212 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.830572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35610 (local address 127.25.227.1:38313)
0811 11:05:46.830653 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.830655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.830720 (+ 65us) server_negotiation.cc:407] Connection header received
0811 11:05:46.830777 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.830778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.830788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.830837 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.831252 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.831986 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.832705 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.833026 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.833083 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.835312 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.835321 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.835321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.835328 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.836925 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.837364 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.837367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.837367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.837427 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.837596 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.837597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.837597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.837720 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.837822 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.837973 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.838075 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 11:05:46.840202 4576 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:46.839587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35626 (local address 127.25.227.1:38313)
0811 11:05:46.839653 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.839654 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.839725 (+ 71us) server_negotiation.cc:407] Connection header received
0811 11:05:46.839813 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.839814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.839826 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.839876 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.840155 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35626: BlockingRecv error: recv got EOF from 127.0.0.1:35626 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 11:05:46.840301 26508 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc' of type FILE
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.841325 26508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.842231 26508 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:46.849496 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.842708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35632 (local address 127.25.227.1:38313)
0811 11:05:46.842770 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.842772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.842784 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:05:46.842857 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.842858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.842868 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.842923 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.843321 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.843802 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.844493 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.844708 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.844819 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.846904 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.846906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.846906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.846920 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.848291 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.848661 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.848662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.848663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.848732 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.848948 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.848949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.848949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.849061 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.849165 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.849314 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.849394 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 11:05:46.851197 26508 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786446315517896-26508-0/krb5kdc/krb5cc' of type FILE
W20260811 11:05:46.851176 4576 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:46.850603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.25.227.1:38313)
0811 11:05:46.850638 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.850640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.850677 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:05:46.850725 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.850726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.850733 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.850780 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.851116 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35634: BlockingRecv error: recv got EOF from 127.0.0.1:35634 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.852164 26508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:46.853027 26508 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[3642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:05:46.859670 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:46.853618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35642 (local address 127.25.227.1:38313)
0811 11:05:46.853682 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:46.853684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:46.853711 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:05:46.853759 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:46.853759 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:46.853767 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:46.853813 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:46.854184 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.854665 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.855305 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:46.855486 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:46.855545 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:46.857535 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:46.857537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:46.857537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:46.857543 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:46.858762 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.859069 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.859070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.859070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.859121 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:46.859299 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:46.859300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:46.859300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:46.859388 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:46.859459 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:46.859561 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 11:05:46.859616 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:05:46.860525 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 3815
I20260811 11:05:46.875867 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 4064
I20260811 11:05:46.901070 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 4322
I20260811 11:05:46.917794 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 3660
2026-08-11T11:05:46Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2267 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[4603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[4603](info): set up 2 sockets
Aug 11 11:05:46 dist-test-slave-z8x9 krb5kdc[4603](info): commencing operation
krb5kdc: starting...
W20260811 11:05:48.219918 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab.
Entry for principal oryx/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab.
I20260811 11:05:48.348479 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:34997
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab
--principal=oryx/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:34997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:48.431150 4624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:48.431406 4624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:48.431447 4624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:48.432601 4624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:48.432673 4624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:48.432698 4624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:48.432717 4624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:48.432747 4624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:48.434278 4624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:34997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab
--principal=oryx/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:34997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:48.434572 4624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:48.434821 4624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:48.439848 4637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.439849 4634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.439877 4639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:48.440105 4624 server_base.cc:1034] running on GCE node
I20260811 11:05:48.440373 4624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:48.440707 4624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:48.441861 4624 hybrid_clock.cc:648] HybridClock initialized: now 1786446348441840 us; error 40 us; skew 500 ppm
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:48.448199 4624 init.cc:377] Logged in from keytab as oryx/127.25.227.62@KRBTEST.COM (short username oryx)
I20260811 11:05:48.448704 4624 webserver.cc:460] Webserver started at http://127.25.227.62:46199/ using document root <none> and password file <none>
I20260811 11:05:48.448953 4624 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:48.449003 4624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:48.449216 4624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:48.450337 4624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "6104767e4b56401585f0253f4034de79"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "8e89a2d40f4e1a8d00c68b4dc12ec47d"
server_key_iv: "8f97f3efb03a633b1b580f57d0436fc1"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.450728 4624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "6104767e4b56401585f0253f4034de79"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "8e89a2d40f4e1a8d00c68b4dc12ec47d"
server_key_iv: "8f97f3efb03a633b1b580f57d0436fc1"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.452405 4624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:48.453274 4654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.453488 4624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:48.453570 4624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "6104767e4b56401585f0253f4034de79"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "8e89a2d40f4e1a8d00c68b4dc12ec47d"
server_key_iv: "8f97f3efb03a633b1b580f57d0436fc1"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.453663 4624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:48.468276 4624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:48.470314 4624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:48.470472 4624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:48.475013 4624 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:34997
I20260811 11:05:48.475083 4760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:34997 every 8 connection(s)
I20260811 11:05:48.475422 4624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:48.476435 4762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:48.478757 4762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Bootstrap starting.
I20260811 11:05:48.479303 4762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:48.479552 4762 log.cc:824] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:48.480213 4762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: No bootstrap required, opened a new log
I20260811 11:05:48.481825 4762 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } }
I20260811 11:05:48.481967 4762 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:48.481990 4762 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6104767e4b56401585f0253f4034de79, State: Initialized, Role: FOLLOWER
I20260811 11:05:48.482095 4762 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } }
I20260811 11:05:48.482182 4762 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:48.482221 4762 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:48.482273 4762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:48.483107 4762 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } }
I20260811 11:05:48.483237 4762 leader_election.cc:302] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6104767e4b56401585f0253f4034de79; no voters:
I20260811 11:05:48.483421 4762 leader_election.cc:288] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:48.483464 4767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:48.483671 4767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 LEADER]: Becoming Leader. State: Replica: 6104767e4b56401585f0253f4034de79, State: Running, Role: LEADER
I20260811 11:05:48.483691 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 4624
I20260811 11:05:48.483790 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:48.483690 4762 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:48.483835 4767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } }
I20260811 11:05:48.484011 26508 external_mini_cluster.cc:1428] Setting key a4a388fe256430a72aeca167eb04ee57
I20260811 11:05:48.484251 4769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } }
I20260811 11:05:48.484337 4769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:48.484596 4772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6104767e4b56401585f0253f4034de79. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } }
I20260811 11:05:48.485008 4772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:48.485150 4780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:48.486151 4780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:48.487907 4780 catalog_manager.cc:1347] Generated new cluster ID: 173f64e75d5847fa964b9069f04c09ba
I20260811 11:05:48.487982 4780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:48.496817 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:48.484700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41614 (local address 127.25.227.62:34997)
0811 11:05:48.484911 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:48.484922 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:48.484997 (+ 75us) server_negotiation.cc:407] Connection header received
0811 11:05:48.485138 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:48.485147 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:48.485238 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:48.485391 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:48.486351 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.487635 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.488714 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.489349 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.489448 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:48.492312 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:48.492317 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:48.492317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:48.492330 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:48.495171 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:48.495580 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:48.495583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:48.495584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:48.495702 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:48.495932 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:48.495933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:48.495933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:48.496219 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:48.496361 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:48.496477 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 11:05:48.496606 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":92,"threads_started":1}
I20260811 11:05:48.505949 4780 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:48.506755 4780 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:48.517467 4780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Generated new TSK 0
I20260811 11:05:48.517670 4780 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab.
Entry for principal oryx/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab.
I20260811 11:05:48.549973 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:34997
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:48.635215 4818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:48.635450 4818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:48.635488 4818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:48.636655 4818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:48.636723 4818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:48.636772 4818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:48.638276 4818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:34997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:48.638542 4818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:48.638789 4818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:48.644011 4827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.644037 4824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.644026 4832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:48.644327 4818 server_base.cc:1034] running on GCE node
I20260811 11:05:48.644546 4818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:48.644797 4818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:48.645961 4818 hybrid_clock.cc:648] HybridClock initialized: now 1786446348645953 us; error 36 us; skew 500 ppm
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:48.648468 4818 init.cc:377] Logged in from keytab as oryx/127.25.227.1@KRBTEST.COM (short username oryx)
I20260811 11:05:48.648892 4818 webserver.cc:460] Webserver started at http://127.25.227.1:37567/ using document root <none> and password file <none>
I20260811 11:05:48.649134 4818 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:48.649228 4818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:48.649401 4818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:48.650427 4818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "5ac0b83cc98144dca2e8f9b6da164dc2"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "b9093607048538ba327c31f8c31bd984"
server_key_iv: "b7e667005d8834d08b8df8246589f550"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.650852 4818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "5ac0b83cc98144dca2e8f9b6da164dc2"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "b9093607048538ba327c31f8c31bd984"
server_key_iv: "b7e667005d8834d08b8df8246589f550"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.652240 4818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:48.652999 4844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.653204 4818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:48.653314 4818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "5ac0b83cc98144dca2e8f9b6da164dc2"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "b9093607048538ba327c31f8c31bd984"
server_key_iv: "b7e667005d8834d08b8df8246589f550"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.653398 4818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:48.670423 4818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:48.672401 4818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:48.672564 4818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:48.672813 4818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:48.673147 4818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:48.673228 4818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.673269 4818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:48.673295 4818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.679494 4818 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:45027
I20260811 11:05:48.679574 5056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:45027 every 8 connection(s)
I20260811 11:05:48.679910 4818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:48.686105 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 4818
I20260811 11:05:48.686187 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:48.686421 26508 external_mini_cluster.cc:1428] Setting key 93231c2d2eaf129018561bd2e931f3ae
I20260811 11:05:48.689990 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:48.680660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:42657 (local address 127.25.227.62:34997)
0811 11:05:48.680708 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:48.680711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:48.680923 (+ 212us) server_negotiation.cc:407] Connection header received
0811 11:05:48.681579 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:48.681580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:48.681598 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:48.681663 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:48.682638 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.683150 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.684269 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.684480 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.684559 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:48.686939 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:48.686940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:48.686941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:48.686949 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:48.688433 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:48.688914 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:48.688916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:48.688916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:48.688996 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:48.689326 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:48.689327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:48.689328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:48.689441 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:48.689498 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:48.689849 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 11:05:48.689924 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:05:48.690274 5060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:48.680629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:42657)
0811 11:05:48.680802 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:48.680839 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:48.681462 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:48.681733 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:48.681737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:48.682339 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:48.682531 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:48.682536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.683252 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.683253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:48.684179 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:48.684181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.684567 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.684569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:48.684699 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:48.685297 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:48.685306 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:48.686835 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:48.688530 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:48.688537 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:48.688540 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:48.688815 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:48.689076 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:48.689076 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:48.689077 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:48.689254 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:48.689507 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:48.689514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:48.689688 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 11:05:48.689803 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 11:05:48.689983 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260811 11:05:48.690761 5058 heartbeater.cc:347] Connected to a master server at 127.25.227.62:34997
I20260811 11:05:48.690874 5058 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:48.691076 5058 heartbeater.cc:511] Master 127.25.227.62:34997 requested a full tablet report, sending...
I20260811 11:05:48.691586 4692 ts_manager.cc:194] Registered new tserver with Master: 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027)
I20260811 11:05:48.692224 4692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:42657
WARNING: no policy specified for oryx/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab.
Entry for principal oryx/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab.
I20260811 11:05:48.715636 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:34997
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:48.800379 5065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:48.800618 5065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:48.800642 5065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:48.801818 5065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:48.801860 5065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:48.801887 5065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:48.803277 5065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:34997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:48.803476 5065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:48.803655 5065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:48.808775 5076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.808751 5081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.808876 5079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:48.808882 5065 server_base.cc:1034] running on GCE node
I20260811 11:05:48.809250 5065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:48.809456 5065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:48.810596 5065 hybrid_clock.cc:648] HybridClock initialized: now 1786446348810581 us; error 30 us; skew 500 ppm
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:48.813042 5065 init.cc:377] Logged in from keytab as oryx/127.25.227.2@KRBTEST.COM (short username oryx)
I20260811 11:05:48.813515 5065 webserver.cc:460] Webserver started at http://127.25.227.2:33409/ using document root <none> and password file <none>
I20260811 11:05:48.813774 5065 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:48.813853 5065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:48.814011 5065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:48.815126 5065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "9c284c232b63421db8f2bf15c256a59e"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "294f55ace27eca304b945ff65a012da3"
server_key_iv: "759ccc351a0200600ace19e8fb18cc58"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.815523 5065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "9c284c232b63421db8f2bf15c256a59e"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "294f55ace27eca304b945ff65a012da3"
server_key_iv: "759ccc351a0200600ace19e8fb18cc58"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.816903 5065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:48.817699 5092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.817880 5065 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.817994 5065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "9c284c232b63421db8f2bf15c256a59e"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "294f55ace27eca304b945ff65a012da3"
server_key_iv: "759ccc351a0200600ace19e8fb18cc58"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.818069 5065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:48.836545 5065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:48.838603 5065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:48.838774 5065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:48.839023 5065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:48.839349 5065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:48.839406 5065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.839442 5065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:48.839488 5065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.846284 5065 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:34073
I20260811 11:05:48.846345 5301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:34073 every 8 connection(s)
I20260811 11:05:48.846699 5065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:48.851073 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 5065
I20260811 11:05:48.851200 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:48.851437 26508 external_mini_cluster.cc:1428] Setting key 03657f86c854e01a61be75dc702b0789
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:48.857643 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:48.847504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:58001 (local address 127.25.227.62:34997)
0811 11:05:48.847595 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:48.847598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:48.847785 (+ 187us) server_negotiation.cc:407] Connection header received
0811 11:05:48.848338 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:48.848340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:48.848351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:48.848413 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:48.849485 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.850015 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.851342 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.851593 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.851653 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:48.854437 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:48.854440 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:48.854440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:48.854448 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:48.856012 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:48.856562 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:48.856563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:48.856563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:48.856625 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:48.856898 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:48.856899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:48.856899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:48.857041 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:48.857103 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:48.857462 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 11:05:48.857550 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 11:05:48.857851 5305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:48.847454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.2:58001)
0811 11:05:48.847658 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:48.847697 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:48.848204 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:48.848495 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:48.848498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:48.849087 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:48.849393 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:48.849398 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.850132 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.850134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:48.851238 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:48.851242 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:48.851771 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:48.851772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:48.851953 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:48.852528 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:48.852541 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:48.854330 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:48.856105 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:48.856112 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:48.856115 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:48.856474 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:48.856711 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:48.856712 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:48.856712 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:48.856823 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:48.857104 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:48.857112 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:48.857317 (+ 205us) client_negotiation.cc:769] Sending connection context
0811 11:05:48.857431 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 11:05:48.857598 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
I20260811 11:05:48.858347 5302 heartbeater.cc:347] Connected to a master server at 127.25.227.62:34997
I20260811 11:05:48.858480 5302 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:48.858722 5302 heartbeater.cc:511] Master 127.25.227.62:34997 requested a full tablet report, sending...
I20260811 11:05:48.859172 4692 ts_manager.cc:194] Registered new tserver with Master: 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073)
I20260811 11:05:48.859793 4692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:58001
WARNING: no policy specified for oryx/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab.
Entry for principal oryx/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab.
I20260811 11:05:48.883562 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:34997
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:48.970268 5308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:48.970471 5308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:48.970494 5308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:48.971668 5308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:48.971712 5308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:48.971738 5308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:48.973132 5308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:34997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:48.973338 5308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:48.973528 5308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:48.978977 5320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.978878 5319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:48.978902 5323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:48.978937 5308 server_base.cc:1034] running on GCE node
I20260811 11:05:48.979429 5308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:48.979664 5308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:48.980803 5308 hybrid_clock.cc:648] HybridClock initialized: now 1786446348980789 us; error 30 us; skew 500 ppm
Aug 11 11:05:48 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:48.983485 5308 init.cc:377] Logged in from keytab as oryx/127.25.227.3@KRBTEST.COM (short username oryx)
I20260811 11:05:48.983968 5308 webserver.cc:460] Webserver started at http://127.25.227.3:45551/ using document root <none> and password file <none>
I20260811 11:05:48.984226 5308 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:48.984300 5308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:48.984441 5308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:48.985585 5308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "7046b4981cc84eeeb4f89f38afe08306"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "c9494a99c422deb1b62088c1ea58dad2"
server_key_iv: "be38606778c1c8903102dd533ab20320"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.985986 5308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "7046b4981cc84eeeb4f89f38afe08306"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "c9494a99c422deb1b62088c1ea58dad2"
server_key_iv: "be38606778c1c8903102dd533ab20320"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.987501 5308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 11:05:48.988269 5341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:48.988440 5308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:48.988547 5308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "7046b4981cc84eeeb4f89f38afe08306"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "c9494a99c422deb1b62088c1ea58dad2"
server_key_iv: "be38606778c1c8903102dd533ab20320"
server_key_version: "encryptionkey@0"
I20260811 11:05:48.988622 5308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.027932 5308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:49.030162 5308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:49.030336 5308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:49.030593 5308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:49.030936 5308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:49.030992 5308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.031040 5308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:49.031075 5308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.037388 5308 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:34063
I20260811 11:05:49.037451 5560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:34063 every 8 connection(s)
I20260811 11:05:49.037873 5308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:49.040155 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 5308
I20260811 11:05:49.040264 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:49.040474 26508 external_mini_cluster.cc:1428] Setting key e36360b3ee08f49b9c0aa2ebc072f0f8
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:49.047927 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.038683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:60973 (local address 127.25.227.62:34997)
0811 11:05:49.038772 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.038775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.038958 (+ 183us) server_negotiation.cc:407] Connection header received
0811 11:05:49.039555 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.039557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.039571 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.039636 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.040776 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.041557 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.042573 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.042792 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.042872 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.045091 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.045093 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.045093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.045102 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.046509 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.046921 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.046922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.046922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.046986 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.047245 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.047246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.047247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.047373 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.047450 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.047734 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.047837 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:05:49.048101 5565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.038658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:60973)
0811 11:05:49.038819 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.038870 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.039438 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.039713 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.039718 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.040409 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.040679 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.040686 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.041649 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.041651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.042471 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.042474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.042879 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.042881 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.043018 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.043586 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.043595 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.044984 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.046596 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.046603 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.046605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.046839 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.047062 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.047063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.047063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.047174 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.047441 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.047448 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.047589 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.047695 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.047858 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
I20260811 11:05:49.048595 5561 heartbeater.cc:347] Connected to a master server at 127.25.227.62:34997
I20260811 11:05:49.048692 5561 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:49.048846 5561 heartbeater.cc:511] Master 127.25.227.62:34997 requested a full tablet report, sending...
I20260811 11:05:49.049234 4692 ts_manager.cc:194] Registered new tserver with Master: 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063)
I20260811 11:05:49.049678 4692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:60973
I20260811 11:05:49.052306 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.227.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.61.keytab.
Entry for principal oryx/127.25.227.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.61.keytab.
I20260811 11:05:49.080240 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:42963
--webserver_interface=127.25.227.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.61.keytab
--principal=oryx/127.25.227.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:34997,127.25.227.61:42963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:49.168009 5571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:49.168241 5571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:49.168263 5571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:49.169430 5571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:49.169474 5571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:49.169489 5571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:49.169502 5571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:49.169516 5571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:49.170971 5571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:34997,127.25.227.61:42963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.61.keytab
--principal=oryx/127.25.227.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:42963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.227.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
W20260811 11:05:49.171084 5571 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.25.227.62:34997,127.25.227.61:42963'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 11:05:49.171208 5571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:49.171391 5571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:49.176373 5578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.176518 5582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.176561 5579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.176611 5571 server_base.cc:1034] running on GCE node
I20260811 11:05:49.176929 5571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:49.177279 5571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:49.178457 5571 hybrid_clock.cc:648] HybridClock initialized: now 1786446349178502 us; error 87 us; skew 500 ppm
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:49.180985 5571 init.cc:377] Logged in from keytab as oryx/127.25.227.61@KRBTEST.COM (short username oryx)
I20260811 11:05:49.181489 5571 webserver.cc:460] Webserver started at http://127.25.227.61:42259/ using document root <none> and password file <none>
I20260811 11:05:49.181733 5571 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.181813 5571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.181980 5571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:49.183037 5571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/instance:
uuid: "068cbebe5d19479cb993f56d3c5be141"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "00e80a1f0c704293ab25254f44db5f01"
server_key_iv: "89d53bf4416a670210464260dc6de9f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.183465 5571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal/instance:
uuid: "068cbebe5d19479cb993f56d3c5be141"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "00e80a1f0c704293ab25254f44db5f01"
server_key_iv: "89d53bf4416a670210464260dc6de9f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.184995 5571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:49.185916 5594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.186113 5571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:49.186220 5571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
uuid: "068cbebe5d19479cb993f56d3c5be141"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "00e80a1f0c704293ab25254f44db5f01"
server_key_iv: "89d53bf4416a670210464260dc6de9f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.186307 5571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.208220 5571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:49.210273 5571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:49.210448 5571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:49.214599 5571 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.61:42963
I20260811 11:05:49.214639 5693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.61:42963 every 8 connection(s)
I20260811 11:05:49.215044 5571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
I20260811 11:05:49.216080 5694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:49.217414 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 5571
I20260811 11:05:49.217846 5694 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.61@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
I20260811 11:05:49.228381 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.218629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41630 (local address 127.25.227.62:34997)
0811 11:05:49.218686 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.218687 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.218830 (+ 143us) server_negotiation.cc:407] Connection header received
0811 11:05:49.219074 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.219075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.219087 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.219145 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.219928 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.220714 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.222090 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.222393 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.222469 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.224967 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.224968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.224968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.224977 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.226809 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.227321 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.227322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.227323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.227376 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.227659 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.227660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.227660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.227828 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.227908 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.228200 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.228289 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 11:05:49.228591 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.218548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:41630)
0811 11:05:49.218697 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.218735 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.218978 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.219188 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.219191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.219576 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.219839 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.219845 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.220809 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.220810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.221996 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.221999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.222481 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.222482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.222576 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.223132 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.223143 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.224872 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.226891 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.226897 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.226899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.227240 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.227455 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.227456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.227457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.227579 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.227912 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.227919 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.228059 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.228165 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.228333 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260811 11:05:49.228698 5701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.218176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41724 (local address 127.25.227.61:42963)
0811 11:05:49.218388 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.218397 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.218432 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:05:49.218967 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.218974 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.218996 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.219116 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.219928 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.221042 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.222090 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.222570 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.222620 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.225579 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.225588 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.225588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.225595 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.227367 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.227713 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.227717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.227717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.227782 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.227989 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.227990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.227990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.228134 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.228291 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.228381 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.228462 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
I20260811 11:05:49.229396 5694 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.61@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
I20260811 11:05:49.235121 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.229675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41732)
0811 11:05:49.229726 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.229736 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.229785 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.229913 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.229913 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.230027 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.230075 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.230075 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.230654 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.230654 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.231119 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.231120 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.231436 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.231437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.231487 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.231905 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.231909 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.233016 (+ 1107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.234358 (+ 1342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.234359 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.234359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.234519 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.234670 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.234671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.234671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.234720 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.234889 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.234889 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.234919 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.234970 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.235043 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 11:05:49.235203 5701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.229778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41732 (local address 127.25.227.61:42963)
0811 11:05:49.229813 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.229815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.229822 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:05:49.229840 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.229841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.229850 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.229909 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.230131 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.230588 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.231183 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.231374 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.231422 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.233083 (+ 1661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.233084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.233084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.233090 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.234288 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.234575 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.234576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.234576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.234617 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.234757 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.234757 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.234757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.234841 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.234884 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.234985 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.235084 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":17}
I20260811 11:05:49.236519 5694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Bootstrap starting.
I20260811 11:05:49.237591 5694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:49.237934 5694 log.cc:824] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:49.238794 5694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: No bootstrap required, opened a new log
I20260811 11:05:49.240509 5694 raft_consensus.cc:348] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } }
I20260811 11:05:49.240662 5694 raft_consensus.cc:374] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:49.240686 5694 raft_consensus.cc:729] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068cbebe5d19479cb993f56d3c5be141, State: Initialized, Role: FOLLOWER
I20260811 11:05:49.240847 5694 consensus_queue.cc:260] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } }
I20260811 11:05:49.241153 5694 sys_catalog.cc:564] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:49.241122 5710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } } }
I20260811 11:05:49.241309 5710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 11:05:49.243281 5731 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:05:49.243341 5731 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:05:49.244874 5571 master_runner.cc:428] Detected that this master 068cbebe5d19479cb993f56d3c5be141 is joining an existing cluster
I20260811 11:05:49.244956 5571 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.227.61:42963
I20260811 11:05:49.252838 5742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.246498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41740)
0811 11:05:49.246617 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.246626 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.246710 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.246825 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.246825 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.247039 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.247177 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.247179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.247824 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.247825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.248465 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.248467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.248839 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.248840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.248908 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.249384 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.249390 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.249868 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.251766 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.251766 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.251767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.251954 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.252182 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.252183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.252183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.252248 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.252492 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.252493 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.252532 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.252600 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.252703 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":78,"threads_started":1}
I20260811 11:05:49.252930 5701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.246476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41740 (local address 127.25.227.61:42963)
0811 11:05:49.246597 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.246599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.246696 (+ 97us) server_negotiation.cc:407] Connection header received
0811 11:05:49.246772 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.246772 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.246781 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.246823 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.247256 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.247724 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.248563 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.248753 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.248826 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.250156 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.250157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.250158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.250164 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.251670 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.252049 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.252050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.252050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.252106 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.252314 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.252315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.252315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.252424 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.252500 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.252625 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.252794 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":105}
I20260811 11:05:49.254258 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.246178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41636 (local address 127.25.227.62:34997)
0811 11:05:49.246226 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.246228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.246377 (+ 149us) server_negotiation.cc:407] Connection header received
0811 11:05:49.246495 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.246496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.246511 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.246547 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.247304 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.248094 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.249272 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.249604 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.249650 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.250708 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.250710 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.250710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.250718 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.252562 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.253291 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.253293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.253293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.253357 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.253784 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.253785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.253786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.253917 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.253972 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.254136 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.254198 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:49.254343 5740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.246079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:41636)
0811 11:05:49.246285 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.246300 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.246410 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.246644 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.246645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.247117 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.247185 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.247187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.248199 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.248200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.249131 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.249134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.249731 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.249732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.249799 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.250188 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.250194 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.250601 (+ 407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.252656 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.252657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.252658 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.253144 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.253632 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.253633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.253633 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.253701 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.253990 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.253991 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.254039 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.254115 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.254213 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":104,"threads_started":1}
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.62@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
I20260811 11:05:49.265282 5701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.257871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41752 (local address 127.25.227.61:42963)
0811 11:05:49.257904 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.257906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.258084 (+ 178us) server_negotiation.cc:407] Connection header received
0811 11:05:49.258165 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.258165 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.258173 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.258219 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.258718 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.259151 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.260240 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.260415 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.260463 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.262667 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.262668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.262669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.262675 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.264036 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.264434 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.264436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.264436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.264496 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.264708 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.264708 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.264709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.264816 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.264893 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.265093 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.265188 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:05:49.265296 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.257816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41752)
0811 11:05:49.257986 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.258023 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.258094 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.258225 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.258227 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.258587 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.258646 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.258649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.259231 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.259232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.260159 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.260162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.260487 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.260488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.260571 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.261012 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.261018 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.262569 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.264138 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.264146 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.264148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.264358 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.264564 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.264565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.264566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.264633 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.264906 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.264913 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.264964 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.265054 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.265175 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":70,"threads_started":1}
I20260811 11:05:49.266054 4692 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.227.61:42963: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "068cbebe5d19479cb993f56d3c5be141"
member_type: NON_VOTER
last_known_addr {
host: "127.25.227.61"
port: 42963
}
attrs {
promote: true
}
}
dest_uuid: "6104767e4b56401585f0253f4034de79"
cas_config_opid_index: -1
I20260811 11:05:49.266310 4692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } }
I20260811 11:05:49.266778 5746 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 068cbebe5d19479cb993f56d3c5be141 (127.25.227.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } }
I20260811 11:05:49.267212 5651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:49.267645 5746 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.227.61:42963
I20260811 11:05:49.267789 5748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } }
I20260811 11:05:49.267865 5748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:49.268370 5651 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Refusing update from remote peer 6104767e4b56401585f0253f4034de79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 11:05:49.268666 5571 master.cc:537] Master@127.25.227.61:42963 shutting down...
I20260811 11:05:49.268718 5748 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.001s
W20260811 11:05:49.270897 4656 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 11:05:49.271337 4656 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 -> Peer 068cbebe5d19479cb993f56d3c5be141 (127.25.227.61:42963): Couldn't send request to peer 068cbebe5d19479cb993f56d3c5be141. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 11:05:49.272119 5571 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:49.272230 5571 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:49.272284 5571 tablet_replica.cc:330] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: stopping tablet replica
I20260811 11:05:49.285352 5571 master.cc:552] Master@127.25.227.61:42963 shutdown complete.
I20260811 11:05:49.285423 5571 master_runner.cc:305] Clearing existing system tablet
I20260811 11:05:49.285560 5571 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.285620 5571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.286278 5571 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:49.286806 5757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.286923 5571 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.286981 5571 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.287010 5571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
uuid: "068cbebe5d19479cb993f56d3c5be141"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "00e80a1f0c704293ab25254f44db5f01"
server_key_iv: "89d53bf4416a670210464260dc6de9f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.287717 5571 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:49.289248 5571 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 11:05:49.289340 5571 log.cc:1196] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 11:05:49.289548 5571 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Deleting consensus metadata
I20260811 11:05:49.289673 5571 master_runner.cc:315] Copying system tablet from 127.25.227.62:34997
I20260811 11:05:49.290297 5571 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: tablet copy: Beginning tablet copy session from remote peer at address 127.25.227.62:34997
I20260811 11:05:49.296854 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.290710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41650 (local address 127.25.227.62:34997)
0811 11:05:49.290772 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.290774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.290905 (+ 131us) server_negotiation.cc:407] Connection header received
0811 11:05:49.290984 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.290984 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.290995 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.291040 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.291390 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.291980 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.292762 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.292961 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.293048 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.294138 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.294140 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.294140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.294147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.295639 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.296014 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.296015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.296016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.296080 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.296286 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.296287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.296287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.296430 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.296501 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.296686 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.296758 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:05:49.296870 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.290656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:41650)
0811 11:05:49.290826 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.290843 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.290919 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.291053 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.291054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.291235 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.291300 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.291302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.292059 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.292061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.292672 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.292674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.293050 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.293051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.293120 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.293710 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.293715 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.294027 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.295743 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.295744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.295744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.295938 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.296149 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.296150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.296150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.296212 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.296521 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.296522 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.296569 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.296647 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.296766 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":71,"threads_started":1}
I20260811 11:05:49.297405 4730 tablet_copy_service.cc:140] P 6104767e4b56401585f0253f4034de79: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 068cbebe5d19479cb993f56d3c5be141 ({username='oryx', principal='oryx/127.25.227.61@KRBTEST.COM'} at 127.0.0.1:41650)
I20260811 11:05:49.297513 4730 tablet_copy_service.cc:161] P 6104767e4b56401585f0253f4034de79: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 068cbebe5d19479cb993f56d3c5be141 at {username='oryx', principal='oryx/127.25.227.61@KRBTEST.COM'} at 127.0.0.1:41650: session id = 068cbebe5d19479cb993f56d3c5be141-00000000000000000000000000000000
I20260811 11:05:49.298207 4730 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 11:05:49.298822 5571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 11:05:49.299757 5571 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: tablet copy: Starting download of 0 data blocks...
I20260811 11:05:49.299907 5571 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: tablet copy: Starting download of 1 WAL segments...
I20260811 11:05:49.300794 5571 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 11:05:49.301622 4730 tablet_copy_service.cc:342] P 6104767e4b56401585f0253f4034de79: Request end of tablet copy session 068cbebe5d19479cb993f56d3c5be141-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.227.61@KRBTEST.COM'} at 127.0.0.1:41650
I20260811 11:05:49.301671 4730 tablet_copy_service.cc:433] P 6104767e4b56401585f0253f4034de79: ending tablet copy session 068cbebe5d19479cb993f56d3c5be141-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 068cbebe5d19479cb993f56d3c5be141
I20260811 11:05:49.304281 5571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:49.305455 5770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.305531 5772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.305727 5571 server_base.cc:1034] running on GCE node
W20260811 11:05:49.309357 5775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.309520 5571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:49.309675 5571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:49.310801 5571 hybrid_clock.cc:648] HybridClock initialized: now 1786446349310793 us; error 26 us; skew 500 ppm
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:49.312280 5571 init.cc:377] Logged in from keytab as oryx/127.25.227.61@KRBTEST.COM (short username oryx)
I20260811 11:05:49.312600 5571 webserver.cc:460] Webserver started at http://127.25.227.61:38967/ using document root <none> and password file <none>
I20260811 11:05:49.312733 5571 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.312791 5571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.313468 5571 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:49.314015 5785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.314188 5571 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:49.314252 5571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
uuid: "068cbebe5d19479cb993f56d3c5be141"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "00e80a1f0c704293ab25254f44db5f01"
server_key_iv: "89d53bf4416a670210464260dc6de9f3"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.314303 5571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.335210 5571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:49.336882 5571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:49.340479 5571 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.61:42963
I20260811 11:05:49.340507 5895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.61:42963 every 8 connection(s)
I20260811 11:05:49.340850 5571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
I20260811 11:05:49.341852 5897 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:05:49.342286 5897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Bootstrap starting.
I20260811 11:05:49.344640 5897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:05:49.344906 5897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Bootstrap complete.
I20260811 11:05:49.345106 5897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } }
I20260811 11:05:49.345227 5897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 068cbebe5d19479cb993f56d3c5be141, State: Initialized, Role: LEARNER
I20260811 11:05:49.345279 5897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } }
I20260811 11:05:49.345454 5897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:49.345449 5900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } }
I20260811 11:05:49.345587 5900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:05:49.346957 5921 catalog_manager.cc:1259] Loaded cluster ID: 173f64e75d5847fa964b9069f04c09ba
I20260811 11:05:49.347021 5921 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: loading cluster ID for follower catalog manager: success
I20260811 11:05:49.348130 5921 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: acquiring CA information for follower catalog manager: success
I20260811 11:05:49.348430 5921 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:05:49.387931 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.380897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41776 (local address 127.25.227.61:42963)
0811 11:05:49.381038 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.381040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.381047 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:05:49.381069 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.381070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.381079 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.381158 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.381763 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.382459 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.383190 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.383476 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.383556 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.385024 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.385028 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.385028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.385040 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.386630 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.387004 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.387006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.387006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.387072 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.387289 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.387290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.387291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.387413 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.387517 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.387623 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.387713 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
WARNING: no policy specified for oryx/127.25.227.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.60.keytab.
Entry for principal oryx/127.25.227.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.60.keytab.
I20260811 11:05:49.419872 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:36121
--webserver_interface=127.25.227.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.60.keytab
--principal=oryx/127.25.227.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:49.514304 5926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:49.514539 5926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:49.514585 5926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:49.515777 5926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:49.515841 5926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:49.515864 5926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:49.515897 5926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:49.515921 5926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:49.517542 5926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.60.keytab
--principal=oryx/127.25.227.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:36121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.227.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:49.517817 5926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:49.518044 5926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:49.523324 5936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.523295 5935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.523269 5939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.523590 5926 server_base.cc:1034] running on GCE node
I20260811 11:05:49.523873 5926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:49.524192 5926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:49.525362 5926 hybrid_clock.cc:648] HybridClock initialized: now 1786446349525337 us; error 42 us; skew 500 ppm
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:49.528095 5926 init.cc:377] Logged in from keytab as oryx/127.25.227.60@KRBTEST.COM (short username oryx)
I20260811 11:05:49.528728 5926 webserver.cc:460] Webserver started at http://127.25.227.60:38281/ using document root <none> and password file <none>
I20260811 11:05:49.528986 5926 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.529060 5926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.529285 5926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:49.530438 5926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/instance:
uuid: "86a9e86941a9484ca5018e80707a64a4"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "c6e3b19ba41b94810751504d49980f53"
server_key_iv: "f39fb1298884cbcd34dae83f39135ba5"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.530855 5926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal/instance:
uuid: "86a9e86941a9484ca5018e80707a64a4"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "c6e3b19ba41b94810751504d49980f53"
server_key_iv: "f39fb1298884cbcd34dae83f39135ba5"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.532393 5926 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:49.533447 5959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.533661 5926 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:49.533800 5926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
uuid: "86a9e86941a9484ca5018e80707a64a4"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "c6e3b19ba41b94810751504d49980f53"
server_key_iv: "f39fb1298884cbcd34dae83f39135ba5"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.533886 5926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.563071 5926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:49.565277 5926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:49.565455 5926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:49.571369 5926 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.60:36121
I20260811 11:05:49.571417 6075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.60:36121 every 8 connection(s)
I20260811 11:05:49.571816 5926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
I20260811 11:05:49.573320 6076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:49.575595 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 5926
I20260811 11:05:49.575619 6076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.60@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.227.60@KRBTEST.COM
I20260811 11:05:49.586592 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.576487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.25.227.62:34997)
0811 11:05:49.576559 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.576561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.576719 (+ 158us) server_negotiation.cc:407] Connection header received
0811 11:05:49.577466 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.577467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.577478 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.577533 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.578835 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.579324 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.580285 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.580477 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.580551 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.583140 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.583142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.583142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.583148 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.585060 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.585567 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.585567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.585568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.585619 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.585954 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.585955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.585955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.586057 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.586134 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.586416 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.586502 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:05:49.586782 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.576371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:41660)
0811 11:05:49.576565 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.576611 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.577367 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.578187 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.578189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.578570 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.578731 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.578738 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.579418 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.579419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.580186 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.580187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.580877 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.580878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.581011 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.581486 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.581494 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.583054 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.585137 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.585145 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.585147 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.585494 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.585687 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.585688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.585688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.585881 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.586126 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.586133 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.586270 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.586374 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.586524 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260811 11:05:49.587424 6076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:05:49.587550 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.576564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33564 (local address 127.25.227.60:36121)
0811 11:05:49.576732 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.576736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.576787 (+ 51us) server_negotiation.cc:407] Connection header received
0811 11:05:49.577372 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.577381 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.577410 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.577533 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.578176 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.579372 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.580066 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.580472 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.580590 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.583703 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.583710 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.583710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.583716 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.585977 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.586330 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.586333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.586333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.586400 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.586611 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.586612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.586613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.586797 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.587327 (+ 530us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.587380 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.587456 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":55,"threads_started":1}
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.60@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
I20260811 11:05:49.593834 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.587679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41792)
0811 11:05:49.587920 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.587930 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.587970 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.588112 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.588113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.588268 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.588301 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.588303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.588915 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.588916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.589477 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.589479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.589806 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.589807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.589847 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.590162 (+ 315us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.590166 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.591353 (+ 1187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.593007 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.593008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.593008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.593163 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.593388 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.593389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.593389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.593444 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.593620 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.593620 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.593654 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.593704 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.593775 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
I20260811 11:05:49.593855 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.587927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41792 (local address 127.25.227.61:42963)
0811 11:05:49.587990 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.587991 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.588001 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:49.588028 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.588031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.588047 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.588095 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.588379 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.588850 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.589545 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.589740 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.589799 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.591432 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.591434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.591434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.591441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.592934 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.593275 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.593276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.593277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.593331 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.593482 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.593483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.593483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.593573 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.593619 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.593720 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.593793 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:05:49.594318 6076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.60@KRBTEST.COM for oryx/127.25.227.60@KRBTEST.COM
I20260811 11:05:49.600313 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.594574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33578)
0811 11:05:49.594628 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.594640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.594681 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.594788 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.594788 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.594898 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.594925 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.594926 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.595502 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.595502 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.595986 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.595987 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.596328 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.596329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.596364 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.596896 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.596901 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.598161 (+ 1260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.599474 (+ 1313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.599475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.599475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.599636 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.599830 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.599830 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.599831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.599883 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.600078 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.600079 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.600110 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.600160 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.600232 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 11:05:49.600366 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.594649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33578 (local address 127.25.227.60:36121)
0811 11:05:49.594684 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.594686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.594693 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:05:49.594727 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.594728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.594736 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.594784 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.594981 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.595423 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.596061 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.596248 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.596315 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.598235 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.598236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.598237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.598243 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.599405 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.599697 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.599698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.599698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.599772 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.599935 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.599935 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.599935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.600027 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.600075 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.600191 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.600279 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":19}
I20260811 11:05:49.602042 6076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Bootstrap starting.
I20260811 11:05:49.602942 6076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:49.603186 6076 log.cc:824] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:49.604024 6076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: No bootstrap required, opened a new log
I20260811 11:05:49.605764 6076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } }
I20260811 11:05:49.605885 6076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:49.605907 6076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86a9e86941a9484ca5018e80707a64a4, State: Initialized, Role: FOLLOWER
I20260811 11:05:49.605994 6076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } }
I20260811 11:05:49.606328 6076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:49.606284 6087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } } }
I20260811 11:05:49.606389 6087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 11:05:49.608616 6108 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:05:49.608687 6108 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:05:49.611039 5926 master_runner.cc:428] Detected that this master 86a9e86941a9484ca5018e80707a64a4 is joining an existing cluster
I20260811 11:05:49.611092 5926 master_runner.cc:432] Initiating AddMaster RPC to add 127.25.227.60:36121
I20260811 11:05:49.620187 6118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.612670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41800)
0811 11:05:49.613245 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.613255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.613341 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.613518 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.613519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.613951 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.614037 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.614039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.615065 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.615066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.615989 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.615991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.616467 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.616467 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.616534 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.616935 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.616940 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.617316 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.619108 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.619109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.619109 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.619282 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.619497 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.619498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.619498 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.619563 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.619844 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.619845 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.619879 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.619929 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.620045 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":458,"threads_started":1}
I20260811 11:05:49.620205 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.612576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41800 (local address 127.25.227.61:42963)
0811 11:05:49.612621 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.612623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.613304 (+ 681us) server_negotiation.cc:407] Connection header received
0811 11:05:49.613412 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.613412 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.613424 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.613455 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.614131 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.614940 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.616081 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.616347 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.616388 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.617410 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.617412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.617412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.617420 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.619026 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.619360 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.619361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.619361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.619428 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.619626 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.619627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.619627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.619778 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.619861 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.619993 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.620100 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:05:49.639369 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 4818
I20260811 11:05:49.641492 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.612223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41664 (local address 127.25.227.62:34997)
0811 11:05:49.612306 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.612308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.612527 (+ 219us) server_negotiation.cc:407] Connection header received
0811 11:05:49.612636 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.612637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.612652 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.612685 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.613355 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.614170 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.615409 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.615742 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.615796 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.637779 (+ 21983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.637785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.637786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.637795 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.639879 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.640354 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.640355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.640356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.640428 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.640681 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.640682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.640682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.640874 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.640929 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.641232 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.641336 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 11:05:49.641996 6114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.612136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:41664)
0811 11:05:49.612465 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.612476 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.612556 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.612751 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.612752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.613051 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.613233 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.613236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.614281 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.614282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.615243 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.615244 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.615909 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.615910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.615967 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.616478 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.616483 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.637607 (+ 21124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.639971 (+ 2364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.639973 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.639973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.640247 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.640516 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.640517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.640517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.640595 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.640989 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.640990 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.641053 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.641652 (+ 599us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.641814 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":249,"threads_started":1}
I20260811 11:05:49.644537 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.612765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33592 (local address 127.25.227.60:36121)
0811 11:05:49.612803 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.612805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.613095 (+ 290us) server_negotiation.cc:407] Connection header received
0811 11:05:49.613205 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.613206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.613215 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.613241 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.613802 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.614586 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.615888 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.616165 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.616206 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.638641 (+ 22435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.638642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.638642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.638649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.643576 (+ 4927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.643886 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.643887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.643887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.643922 (+ 35us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.644065 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.644066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.644066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.644170 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.644202 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.644353 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.644420 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:05:49.645068 6116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.612641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33592)
0811 11:05:49.613027 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.613038 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.613117 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.613299 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.613300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.613606 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.613698 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.613700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.614699 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.614700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.615790 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.615793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.616275 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.616275 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.616340 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.637963 (+ 21623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.637968 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.638531 (+ 563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.643652 (+ 5121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.643652 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.643653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.643829 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.643974 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.643975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.643975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.644016 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.644233 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.644234 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.644272 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.644746 (+ 474us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.644850 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":256,"threads_started":1}
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446348, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.62@KRBTEST.COM for oryx/127.25.227.60@KRBTEST.COM
I20260811 11:05:49.663733 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:45027
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:34997
--webserver_port=37567
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:05:49.666069 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.656680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33598)
0811 11:05:49.657657 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.657670 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.657719 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.658144 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.658145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.658352 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.658408 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.658411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.659329 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.659331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.660208 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.660212 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.660727 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.660728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.660816 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.661322 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.661328 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.662982 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.664807 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.664808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.664809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.664994 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.665295 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.665296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.665296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.665388 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.665706 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.665707 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.665770 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.665853 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.665962 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954}
I20260811 11:05:49.666229 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.657876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.25.227.60:36121)
0811 11:05:49.657979 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.657982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.657989 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:05:49.658019 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.658020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.658031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.658086 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.658477 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.659223 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.660314 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.660634 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.660709 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.663084 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.663086 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.663086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.663093 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.664696 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.665071 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.665072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.665073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.665159 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.665479 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.665480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.665481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.665622 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.665693 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.665913 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.666004 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 11:05:49.666707 4692 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.25.227.60:36121: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "86a9e86941a9484ca5018e80707a64a4"
member_type: NON_VOTER
last_known_addr {
host: "127.25.227.60"
port: 36121
}
attrs {
promote: true
}
}
dest_uuid: "6104767e4b56401585f0253f4034de79"
cas_config_opid_index: 5
I20260811 11:05:49.667004 4692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } }
I20260811 11:05:49.667433 5746 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.667804 6015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:49.668444 5746 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.25.227.60:36121
I20260811 11:05:49.668525 5746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.668587 5746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:49.668830 6015 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Refusing update from remote peer 6104767e4b56401585f0253f4034de79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 11:05:49.668987 5926 master.cc:537] Master@127.25.227.60:36121 shutting down...
I20260811 11:05:49.670274 5748 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 11:05:49.671036 4659 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 -> Peer 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60:36121): Couldn't send request to peer 86a9e86941a9484ca5018e80707a64a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 11:05:49.673619 5926 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:49.673722 5926 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:49.673771 5926 tablet_replica.cc:330] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: stopping tablet replica
I20260811 11:05:49.674775 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.667464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41814)
0811 11:05:49.669685 (+ 2221us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.669697 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.669739 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.671313 (+ 1574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.671314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.671316 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:49.671359 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.671361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.672303 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.672304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.673137 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.673139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.674490 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.674492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.674567 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.674591 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.674646 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.674699 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2204}
I20260811 11:05:49.675057 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.668816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41814 (local address 127.25.227.61:42963)
0811 11:05:49.671125 (+ 2309us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.671127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.671136 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:49.671163 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.671164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.671188 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.671250 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:49.671438 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.672200 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.673710 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.674292 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.674364 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.674452 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.674937 (+ 485us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.674987 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2281}
I20260811 11:05:49.675261 5837 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 LEARNER]: Refusing update from remote peer 6104767e4b56401585f0253f4034de79: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 11:05:49.675509 5748 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 11:05:49.676102 5837 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.677079 5900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6104767e4b56401585f0253f4034de79. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.677203 5900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:05:49.677243 5900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: NON_VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: true } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.677278 5900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:05:49.677502 5748 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: attempting to promote NON_VOTER 068cbebe5d19479cb993f56d3c5be141 to VOTER
I20260811 11:05:49.677693 5748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } }
I20260811 11:05:49.678174 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.678067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33608)
0811 11:05:49.678106 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.678147 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:36121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 11:05:49.678231 5837 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 LEARNER]: Refusing update from remote peer 6104767e4b56401585f0253f4034de79: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 11:05:49.678460 5744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.678383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33616)
0811 11:05:49.678415 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.678437 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:36121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 11:05:49.678483 5748 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 11:05:49.678541 4659 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 -> Peer 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60:36121): Couldn't send request to peer 86a9e86941a9484ca5018e80707a64a4. Status: Network error: Client connection negotiation failed: client connection to 127.25.227.60:36121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 11:05:49.679132 5746 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 068cbebe5d19479cb993f56d3c5be141 (127.25.227.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.679355 5837 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 068cbebe5d19479cb993f56d3c5be141 (127.25.227.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.680088 5746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.680172 5746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:49.680199 5748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.680260 5748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:49.680325 6124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.680415 6124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:05:49.688532 5926 master.cc:552] Master@127.25.227.60:36121 shutdown complete.
I20260811 11:05:49.688603 5926 master_runner.cc:305] Clearing existing system tablet
I20260811 11:05:49.688735 5926 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.688803 5926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.689536 5926 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260811 11:05:49.690083 6128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.690267 5926 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.690331 5926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:49.690361 5926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
uuid: "86a9e86941a9484ca5018e80707a64a4"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "c6e3b19ba41b94810751504d49980f53"
server_key_iv: "f39fb1298884cbcd34dae83f39135ba5"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.691090 5926 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:49.692410 5926 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 11:05:49.692495 5926 log.cc:1196] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 11:05:49.692700 5926 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Deleting consensus metadata
I20260811 11:05:49.692863 5926 master_runner.cc:315] Copying system tablet from 127.25.227.62:34997
I20260811 11:05:49.693526 5926 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: tablet copy: Beginning tablet copy session from remote peer at address 127.25.227.62:34997
I20260811 11:05:49.703032 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.693900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41670 (local address 127.25.227.62:34997)
0811 11:05:49.693948 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.693951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.697284 (+ 3333us) server_negotiation.cc:407] Connection header received
0811 11:05:49.697360 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.697361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.697373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.697420 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.697745 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.698257 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.698976 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.699187 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.699294 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.700322 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.700323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.700324 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.700332 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.701834 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.702219 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.702220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.702221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.702288 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.702502 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.702503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.702504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.702620 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.702697 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.702866 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.702941 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:05:49.703047 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.693860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:41670)
0811 11:05:49.697200 (+ 3340us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.697214 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.697291 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.697434 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.697435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.697620 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.697661 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.697663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.698346 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.698347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.698884 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.698886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.699329 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.699331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.699389 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.699895 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.699901 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.700211 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.701942 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.701943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.701944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.702128 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.702369 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.702370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.702370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.702434 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.702688 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.702690 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.702737 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.702822 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.702938 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3294,"thread_start_us":70,"threads_started":1}
I20260811 11:05:49.703608 4730 tablet_copy_service.cc:140] P 6104767e4b56401585f0253f4034de79: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 86a9e86941a9484ca5018e80707a64a4 ({username='oryx', principal='oryx/127.25.227.60@KRBTEST.COM'} at 127.0.0.1:41670)
I20260811 11:05:49.703684 4730 tablet_copy_service.cc:161] P 6104767e4b56401585f0253f4034de79: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 86a9e86941a9484ca5018e80707a64a4 at {username='oryx', principal='oryx/127.25.227.60@KRBTEST.COM'} at 127.0.0.1:41670: session id = 86a9e86941a9484ca5018e80707a64a4-00000000000000000000000000000000
I20260811 11:05:49.704142 4730 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 11:05:49.704622 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 11:05:49.705622 5926 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: tablet copy: Starting download of 0 data blocks...
I20260811 11:05:49.705853 5926 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: tablet copy: Starting download of 1 WAL segments...
I20260811 11:05:49.706594 5926 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 11:05:49.707504 4730 tablet_copy_service.cc:342] P 6104767e4b56401585f0253f4034de79: Request end of tablet copy session 86a9e86941a9484ca5018e80707a64a4-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.25.227.60@KRBTEST.COM'} at 127.0.0.1:41670
I20260811 11:05:49.707561 4730 tablet_copy_service.cc:433] P 6104767e4b56401585f0253f4034de79: ending tablet copy session 86a9e86941a9484ca5018e80707a64a4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 86a9e86941a9484ca5018e80707a64a4
I20260811 11:05:49.709918 5926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:49.711139 6145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.711086 6141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.711294 5926 server_base.cc:1034] running on GCE node
W20260811 11:05:49.711130 6143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.711524 5926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:49.711658 5926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:49.712779 5926 hybrid_clock.cc:648] HybridClock initialized: now 1786446349712771 us; error 26 us; skew 500 ppm
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:49.714308 5926 init.cc:377] Logged in from keytab as oryx/127.25.227.60@KRBTEST.COM (short username oryx)
I20260811 11:05:49.714603 5926 webserver.cc:460] Webserver started at http://127.25.227.60:38695/ using document root <none> and password file <none>
I20260811 11:05:49.714725 5926 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.714759 5926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.715469 5926 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:49.716006 6160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.716260 5926 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.716312 5926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
uuid: "86a9e86941a9484ca5018e80707a64a4"
format_stamp: "Formatted at 2026-08-11 11:05:49 on dist-test-slave-z8x9"
server_key: "c6e3b19ba41b94810751504d49980f53"
server_key_iv: "f39fb1298884cbcd34dae83f39135ba5"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.716372 5926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.743530 5926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:49.745541 5926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:49.748909 5926 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.60:36121
I20260811 11:05:49.749434 5926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
I20260811 11:05:49.750329 6248 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:05:49.750833 6248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Bootstrap starting.
I20260811 11:05:49.753146 6248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:05:49.753306 6247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.60:36121 every 8 connection(s)
I20260811 11:05:49.753439 6248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: Bootstrap complete.
I20260811 11:05:49.753577 6248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } }
I20260811 11:05:49.753633 6248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 86a9e86941a9484ca5018e80707a64a4, State: Initialized, Role: LEARNER
I20260811 11:05:49.753657 6248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } }
I20260811 11:05:49.753870 6248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:49.753827 6253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:49.753925 6253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:05:49.755304 6274 catalog_manager.cc:1259] Loaded cluster ID: 173f64e75d5847fa964b9069f04c09ba
I20260811 11:05:49.755470 6274 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: loading cluster ID for follower catalog manager: success
I20260811 11:05:49.756579 6274 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: acquiring CA information for follower catalog manager: success
I20260811 11:05:49.756889 6274 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 11:05:49.789217 6120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:49.789512 6120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:49.789548 6120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:49.791240 6120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:49.791298 6120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:49.791358 6120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:49.793668 6120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:45027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=37567
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:49.794005 6120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:49.794270 6120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:49.800259 6282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.800390 6283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.800246 6286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.800716 6120 server_base.cc:1034] running on GCE node
I20260811 11:05:49.800932 6120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:49.801240 6120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:49.802431 6120 hybrid_clock.cc:648] HybridClock initialized: now 1786446349802426 us; error 42 us; skew 500 ppm
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:49.805359 6120 init.cc:377] Logged in from keytab as oryx/127.25.227.1@KRBTEST.COM (short username oryx)
I20260811 11:05:49.805832 6120 webserver.cc:460] Webserver started at http://127.25.227.1:37567/ using document root <none> and password file <none>
I20260811 11:05:49.806121 6120 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.806185 6120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.807848 6120 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:49.808643 6293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.808880 6120 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:05:49.808985 6120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "5ac0b83cc98144dca2e8f9b6da164dc2"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "b9093607048538ba327c31f8c31bd984"
server_key_iv: "b7e667005d8834d08b8df8246589f550"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.809424 6120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.840385 6120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:49.842962 6120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:49.843179 6120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:49.843463 6120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:49.843811 6120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:49.843868 6120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.843910 6120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:49.843953 6120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.857857 6120 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:45027
I20260811 11:05:49.857956 6516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:45027 every 8 connection(s)
I20260811 11:05:49.858371 6120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:49.860900 5302 heartbeater.cc:503] Master 127.25.227.62:34997 was elected leader, sending a full tablet report...
I20260811 11:05:49.861521 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 6120
I20260811 11:05:49.861678 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 5065
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.60@KRBTEST.COM
I20260811 11:05:49.873880 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.859231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:55021 (local address 127.25.227.62:34997)
0811 11:05:49.859286 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.859288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.859853 (+ 565us) server_negotiation.cc:407] Connection header received
0811 11:05:49.861493 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.861494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.861507 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.861541 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.862805 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.863456 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.864800 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.865236 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.865318 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.868348 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.868350 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.868350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.868358 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.870138 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.870615 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.870616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.870617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.870688 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.871060 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.871061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.871062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.871255 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.871312 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.873686 (+ 2374us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.873781 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:05:49.874185 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.859250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:55021)
0811 11:05:49.859687 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.859738 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.861373 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.861697 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.861713 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.862296 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.862685 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.862690 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.863550 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.863551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.864698 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.864710 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.865400 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.865401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.865594 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.866233 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.866246 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.868247 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.870238 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.870246 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.870248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.870538 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.870779 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.870779 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.870780 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.870959 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.871372 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.871381 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.873488 (+ 2107us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.873647 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.873840 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"spinlock_wait_cycles":8832,"thread_start_us":378,"threads_started":1}
I20260811 11:05:49.874730 6518 heartbeater.cc:347] Connected to a master server at 127.25.227.62:34997
I20260811 11:05:49.874861 6518 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:49.875074 6518 heartbeater.cc:511] Master 127.25.227.62:34997 requested a full tablet report, sending...
I20260811 11:05:49.875551 4692 ts_manager.cc:194] Re-registered known tserver with Master: 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027)
I20260811 11:05:49.876327 4692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:55021
I20260811 11:05:49.877614 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.859918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:45983 (local address 127.25.227.61:42963)
0811 11:05:49.859967 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.859969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.860050 (+ 81us) server_negotiation.cc:407] Connection header received
0811 11:05:49.861590 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.861591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.861606 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.861656 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.864957 (+ 3301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.865736 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.868281 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.868977 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.869036 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.873871 (+ 4835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.873873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.873873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.873883 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.875988 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.876503 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.876505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.876505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.876579 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.876808 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.876810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.876810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.876971 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.877049 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.877352 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.877463 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:05:49.878080 6526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.859853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.25.227.1:45983)
0811 11:05:49.859998 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.860007 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.861466 (+ 1459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.861752 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.861752 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.864756 (+ 3004us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.864854 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.864856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.865833 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.865834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.867103 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.867107 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.869126 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.869127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.869543 (+ 416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.871086 (+ 1543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.871091 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.873742 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.876095 (+ 2353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.876096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.876097 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.876397 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.876670 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.876670 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.876671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.876737 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.877061 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.877062 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.877137 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.877764 (+ 627us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.877906 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
I20260811 11:05:49.878635 6519 heartbeater.cc:347] Connected to a master server at 127.25.227.61:42963
I20260811 11:05:49.878683 6519 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:49.878741 6519 heartbeater.cc:511] Master 127.25.227.61:42963 requested a full tablet report, sending...
I20260811 11:05:49.879114 5820 ts_manager.cc:194] Registered new tserver with Master: 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027)
I20260811 11:05:49.879864 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.859233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:46257 (local address 127.25.227.60:36121)
0811 11:05:49.859350 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:49.859352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:49.859857 (+ 505us) server_negotiation.cc:407] Connection header received
0811 11:05:49.861637 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:49.861639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:49.861659 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:49.861702 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:49.865103 (+ 3401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.866117 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.870024 (+ 3907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.870465 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.870521 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.875661 (+ 5140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:49.875662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:49.875663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:49.875681 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:49.877988 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.878468 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.878469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.878469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.878545 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:49.878974 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:49.878976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:49.878976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:49.879231 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:49.879304 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:49.879573 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 11:05:49.879710 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260811 11:05:49.880268 6525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:49.859250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.25.227.1:46257)
0811 11:05:49.859687 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:49.859738 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:49.861363 (+ 1625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:49.861782 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:49.861783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:49.864957 (+ 3174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:49.865011 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.865013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.866218 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.866218 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.868143 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:49.868147 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:49.870615 (+ 2468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:49.870616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:49.870684 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:49.871827 (+ 1143us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:49.871832 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:49.875543 (+ 3711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:49.878074 (+ 2531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.878075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.878075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.878381 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.878634 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:49.878635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:49.878635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:49.878844 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:49.879351 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:49.879352 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:49.879412 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 11:05:49.879956 (+ 544us) client_negotiation.cc:240] Negotiation successful
0811 11:05:49.880091 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":897,"thread_start_us":348,"threads_started":1}
I20260811 11:05:49.881325 6517 heartbeater.cc:347] Connected to a master server at 127.25.227.60:36121
I20260811 11:05:49.881378 6517 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:49.881439 6517 heartbeater.cc:511] Master 127.25.227.60:36121 requested a full tablet report, sending...
I20260811 11:05:49.881847 6185 ts_manager.cc:194] Registered new tserver with Master: 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027)
I20260811 11:05:49.885583 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:34073
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:34997
--webserver_port=33409
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:49.971197 6529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:49.971419 6529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:49.971444 6529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:49.972705 6529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:49.972759 6529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:49.972785 6529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:49.974462 6529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:34073
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=33409
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:49.974730 6529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:49.974983 6529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:49.980607 6541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.980774 6529 server_base.cc:1034] running on GCE node
W20260811 11:05:49.980638 6539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:49.980826 6544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:49.981078 6529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:49.981357 6529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:49.982529 6529 hybrid_clock.cc:648] HybridClock initialized: now 1786446349982507 us; error 39 us; skew 500 ppm
Aug 11 11:05:49 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:49.985499 6529 init.cc:377] Logged in from keytab as oryx/127.25.227.2@KRBTEST.COM (short username oryx)
I20260811 11:05:49.985963 6529 webserver.cc:460] Webserver started at http://127.25.227.2:33409/ using document root <none> and password file <none>
I20260811 11:05:49.986195 6529 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:49.986280 6529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:49.987608 6529 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:49.988250 6556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:49.988459 6529 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:05:49.988566 6529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "9c284c232b63421db8f2bf15c256a59e"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "294f55ace27eca304b945ff65a012da3"
server_key_iv: "759ccc351a0200600ace19e8fb18cc58"
server_key_version: "encryptionkey@0"
I20260811 11:05:49.988911 6529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:49.998744 6529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:50.001330 6529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:50.001495 6529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:50.001742 6529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:50.002077 6529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:50.002132 6529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:50.002180 6529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:50.002206 6529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:50.008296 6529 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:34073
I20260811 11:05:50.008378 6807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:34073 every 8 connection(s)
I20260811 11:05:50.008760 6529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:50.011107 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 6529
I20260811 11:05:50.011296 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 5308
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.60@KRBTEST.COM
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446349, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
I20260811 11:05:50.024310 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.009991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:36549 (local address 127.25.227.62:34997)
0811 11:05:50.010044 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.010046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.010084 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:05:50.011054 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.011056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.011071 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.011105 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.012365 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.013024 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.015768 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.016033 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.016078 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.019901 (+ 3823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.019902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.019902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.019910 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.022430 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.022839 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.022840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.022841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.023092 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.023696 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.023698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.023698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.023844 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.023895 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.024115 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.024201 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 11:05:50.024915 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.009619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:41807 (local address 127.25.227.60:36121)
0811 11:05:50.009695 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.009698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.009883 (+ 185us) server_negotiation.cc:407] Connection header received
0811 11:05:50.011054 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.011055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.011073 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.011105 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.014253 (+ 3148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.014864 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.016560 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.016837 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.016874 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.019884 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.019886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.019886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.019894 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.021861 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.022407 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.022409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.022409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.022476 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.022839 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.022840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.022840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.022995 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.023044 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.024698 (+ 1654us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.024797 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:05:50.025557 6817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.009569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.25.227.2:41807)
0811 11:05:50.009755 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.009799 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.010919 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.011314 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.011318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.011737 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:50.012001 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.012006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.014952 (+ 2946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.014952 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.015681 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.015682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.016942 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.016943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.017006 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.017997 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:50.018002 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:50.019758 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:50.021959 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.021969 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.021972 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.022306 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.022612 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.022613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.022613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.022757 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.023193 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:50.023201 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:50.023383 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.025235 (+ 1852us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.025439 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":115,"threads_started":1}
I20260811 11:05:50.025556 6818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.009890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.2:36549)
0811 11:05:50.010031 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.010041 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.010931 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.011314 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.011318 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.012213 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:50.012285 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.012286 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.013140 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.013141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.014125 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.014127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.016168 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.016169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.016315 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.017233 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:50.017244 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:50.019758 (+ 2514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:50.022524 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.022525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.022525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.022729 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.023520 (+ 791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.023520 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.023521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.023613 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.023950 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:50.023950 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:50.023991 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.024094 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.024292 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260811 11:05:50.026084 6809 heartbeater.cc:347] Connected to a master server at 127.25.227.60:36121
I20260811 11:05:50.026189 6809 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:50.026388 6809 heartbeater.cc:511] Master 127.25.227.60:36121 requested a full tablet report, sending...
I20260811 11:05:50.026755 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.009551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:42903 (local address 127.25.227.61:42963)
0811 11:05:50.009683 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.009686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.009927 (+ 241us) server_negotiation.cc:407] Connection header received
0811 11:05:50.011056 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.011057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.011071 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.011106 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.017085 (+ 5979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.018395 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.019672 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.020056 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.020109 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.022968 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.022970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.022970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.022978 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.025127 (+ 2149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.025714 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.025716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.025717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.025792 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.026069 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.026070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.026070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.026244 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.026316 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.026563 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.026655 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 11:05:50.026899 6185 ts_manager.cc:194] Registered new tserver with Master: 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073)
I20260811 11:05:50.026925 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.009567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.25.227.2:42903)
0811 11:05:50.009754 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.009798 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.010920 (+ 1122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.011323 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.011324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.016374 (+ 5050us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:50.016959 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.016963 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.018515 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.018516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.019547 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.019551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.020201 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.020202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.020345 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.020699 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:50.020705 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:50.022875 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:50.025234 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.025235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.025236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.025595 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.025887 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.025888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.025888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.025970 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.026377 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:50.026378 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:50.026436 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.026530 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.026669 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":103,"threads_started":1}
I20260811 11:05:50.038506 6814 heartbeater.cc:347] Connected to a master server at 127.25.227.61:42963
I20260811 11:05:50.038581 6814 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:50.038681 6814 heartbeater.cc:511] Master 127.25.227.61:42963 requested a full tablet report, sending...
I20260811 11:05:50.038968 6811 heartbeater.cc:347] Connected to a master server at 127.25.227.62:34997
I20260811 11:05:50.039052 6811 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:50.039124 6811 heartbeater.cc:511] Master 127.25.227.62:34997 requested a full tablet report, sending...
I20260811 11:05:50.039098 5820 ts_manager.cc:194] Registered new tserver with Master: 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073)
I20260811 11:05:50.039415 4692 ts_manager.cc:194] Re-registered known tserver with Master: 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073)
I20260811 11:05:50.039834 4692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:36549
I20260811 11:05:50.043015 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:34063
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:34997
--webserver_port=45551
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:50.128804 6820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:50.129011 6820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:50.129035 6820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:50.130240 6820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:50.130287 6820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:50.130344 6820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:50.131845 6820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:34063
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=45551
--tserver_master_addrs=127.25.227.62:34997,127.25.227.61:42963,127.25.227.60:36121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:50.132089 6820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:50.132335 6820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:50.137564 6828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:50.137593 6831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:50.137725 6820 server_base.cc:1034] running on GCE node
W20260811 11:05:50.137832 6829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:50.138041 6820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:50.138312 6820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:50.139498 6820 hybrid_clock.cc:648] HybridClock initialized: now 1786446350139476 us; error 42 us; skew 500 ppm
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446350, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:50.142207 6820 init.cc:377] Logged in from keytab as oryx/127.25.227.3@KRBTEST.COM (short username oryx)
I20260811 11:05:50.142659 6820 webserver.cc:460] Webserver started at http://127.25.227.3:45551/ using document root <none> and password file <none>
I20260811 11:05:50.142885 6820 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:50.142939 6820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:50.144269 6820 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:50.145143 6850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:50.145361 6820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:50.145465 6820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "7046b4981cc84eeeb4f89f38afe08306"
format_stamp: "Formatted at 2026-08-11 11:05:48 on dist-test-slave-z8x9"
server_key: "c9494a99c422deb1b62088c1ea58dad2"
server_key_iv: "be38606778c1c8903102dd533ab20320"
server_key_version: "encryptionkey@0"
I20260811 11:05:50.145831 6820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:50.165318 6820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:50.167856 6820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:50.168004 6820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:50.168301 6820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:50.168642 6820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:50.168696 6820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:50.168735 6820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:50.168784 6820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:50.176014 6820 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:34063
I20260811 11:05:50.176060 7056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:34063 every 8 connection(s)
I20260811 11:05:50.176457 6820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:50.178951 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 6820
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446350, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446350, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.61@KRBTEST.COM
Aug 11 11:05:50 dist-test-slave-z8x9 krb5kdc[4603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446350, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.60@KRBTEST.COM
I20260811 11:05:50.191349 7064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.177496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:40675)
0811 11:05:50.177729 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.177741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.178299 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.178676 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.178677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.179692 (+ 1015us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:50.179779 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.179782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.180588 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.180589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.182060 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.182063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.182615 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.182775 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.183710 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:50.183721 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:50.185764 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:50.189338 (+ 3574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.189349 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.189352 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.189724 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.190006 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.190007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.190008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.190170 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.190522 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:50.190530 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:50.190712 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.190842 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.191063 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":677,"thread_start_us":103,"threads_started":1}
I20260811 11:05:50.191424 4790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.177402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:40675 (local address 127.25.227.62:34997)
0811 11:05:50.177457 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.177459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.177820 (+ 361us) server_negotiation.cc:407] Connection header received
0811 11:05:50.178563 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.178565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.178580 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.178638 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.179863 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.180453 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182161 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.182466 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182533 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.185876 (+ 3343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.185878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.185878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.185887 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.189229 (+ 3342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.189833 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.189834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.189835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.189948 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.190258 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.190259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.190260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.190423 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.190491 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.191232 (+ 741us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.191322 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:50.192634 7059 heartbeater.cc:347] Connected to a master server at 127.25.227.62:34997
I20260811 11:05:50.192749 7059 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:50.193001 7059 heartbeater.cc:511] Master 127.25.227.62:34997 requested a full tablet report, sending...
I20260811 11:05:50.193362 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.177843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:45267 (local address 127.25.227.61:42963)
0811 11:05:50.177888 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.177889 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.177927 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:05:50.178599 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.178601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.178612 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.178677 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.179749 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.180518 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182171 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.182477 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182518 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.187704 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.187707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.187707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.187715 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.191226 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.192382 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.192383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.192384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.192445 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.192663 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.192664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.192664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.192792 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.192841 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.193127 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.193236 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:05:50.193419 4692 ts_manager.cc:194] Re-registered known tserver with Master: 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063)
I20260811 11:05:50.193743 7065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.177736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.25.227.3:45267)
0811 11:05:50.177875 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.177884 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.178310 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.178718 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.178719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.179215 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:50.179629 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.179635 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.180618 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.180619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.182061 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.182064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.182602 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.182775 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.183921 (+ 1146us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:50.183926 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:50.187326 (+ 3400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:50.191960 (+ 4634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.191961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.191962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.192240 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.192521 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.192522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.192523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.192586 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.192895 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:50.192896 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:50.192998 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.193496 (+ 498us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.193605 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":21,"thread_start_us":59,"threads_started":1}
I20260811 11:05:50.193926 4692 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:40675
I20260811 11:05:50.194703 7060 heartbeater.cc:347] Connected to a master server at 127.25.227.61:42963
I20260811 11:05:50.194761 7060 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:50.194825 7060 heartbeater.cc:511] Master 127.25.227.61:42963 requested a full tablet report, sending...
I20260811 11:05:50.194978 7081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.180981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41676 (local address 127.25.227.62:34997)
0811 11:05:50.182206 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.182208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.182426 (+ 218us) server_negotiation.cc:407] Connection header received
0811 11:05:50.183267 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.183268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.183283 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.183334 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.185025 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.185905 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.187428 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.187719 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.187784 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.189618 (+ 1834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.189620 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.189620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.189628 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.193074 (+ 3446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.193581 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.193582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.193582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.193641 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.193828 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.193829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.193829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.193935 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.194019 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.194204 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.194870 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1205,"thread_start_us":127,"threads_started":1}
I20260811 11:05:50.195047 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.181103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33626 (local address 127.25.227.60:36121)
0811 11:05:50.182259 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.182261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.182517 (+ 256us) server_negotiation.cc:407] Connection header received
0811 11:05:50.182674 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.182674 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.182686 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.182841 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.183901 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.186186 (+ 2285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.187194 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.187508 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.187547 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.190817 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.190818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.190819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.190825 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.192977 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.193705 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.193706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.193707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.193972 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.194242 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.194243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.194243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.194515 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.194608 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.194831 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.194923 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1137,"thread_start_us":75,"threads_started":1}
I20260811 11:05:50.195132 5820 ts_manager.cc:194] Registered new tserver with Master: 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063)
I20260811 11:05:50.196468 7062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.177386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.25.227.3:52985)
0811 11:05:50.177628 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.177678 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.178299 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.178616 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.178620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.179345 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:50.179629 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.179635 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.180618 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.180619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.182061 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.182064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.182603 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.182775 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.184011 (+ 1236us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:50.184016 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:50.188887 (+ 4871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:50.191489 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.191490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.191490 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.191729 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.195728 (+ 3999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:50.195728 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:50.195729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:50.195791 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:50.196071 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:50.196072 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:50.196133 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.196199 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.196342 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":279,"thread_start_us":95,"threads_started":1}
I20260811 11:05:50.196635 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.177379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:52985 (local address 127.25.227.60:36121)
0811 11:05:50.177538 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.177541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.177779 (+ 238us) server_negotiation.cc:407] Connection header received
0811 11:05:50.178442 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.178443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.178458 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.178527 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.179749 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.180515 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182171 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.182473 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.182518 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.189010 (+ 6492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.189011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.189012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.189020 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.190794 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.192219 (+ 1425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.192220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.192221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.192330 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.195849 (+ 3519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.195851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.195851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.196006 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.196075 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.196419 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.196512 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260811 11:05:50.197145 7086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.181380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41830 (local address 127.25.227.61:42963)
0811 11:05:50.182309 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.182311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.183147 (+ 836us) server_negotiation.cc:407] Connection header received
0811 11:05:50.183187 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.183188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.183203 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.183272 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.184189 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.184877 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.186696 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.187054 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.187101 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.189457 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.189458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.189459 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.189830 (+ 371us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.195612 (+ 5782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.196004 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.196005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.196006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.196069 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.196297 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.196298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.196298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.196433 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.196517 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.196941 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.197029 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":910,"thread_start_us":53,"threads_started":1}
I20260811 11:05:50.197186 7058 heartbeater.cc:347] Connected to a master server at 127.25.227.60:36121
I20260811 11:05:50.197237 7058 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:50.197286 7058 heartbeater.cc:511] Master 127.25.227.60:36121 requested a full tablet report, sending...
I20260811 11:05:50.197525 6185 ts_manager.cc:194] Registered new tserver with Master: 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063)
I20260811 11:05:50.196777 4692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:50.198908 4692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:50.206570 7109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.203021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:45027 (local address 127.0.0.1:55618)
0811 11:05:50.203460 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.203468 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.203508 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.203691 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.203692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.203694 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:50.203743 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.203752 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.204680 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.204680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.205637 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.205640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.206313 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.206314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.206375 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.206381 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.206455 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.206498 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":60,"threads_started":1}
I20260811 11:05:50.206584 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.203219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55618 (local address 127.25.227.1:45027)
0811 11:05:50.203405 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.203410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.203512 (+ 102us) server_negotiation.cc:407] Connection header received
0811 11:05:50.203577 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.203579 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.203592 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.203680 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:50.203814 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.204596 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.205723 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.206203 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.206309 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.206396 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.206470 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.206511 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
I20260811 11:05:50.207715 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.202839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34063 (local address 127.0.0.1:36556)
0811 11:05:50.203092 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.203104 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.203177 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.204064 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.204065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.204067 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:50.204105 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.204106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.205487 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.205488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.206567 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.206570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.207456 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.207457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.207522 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.207527 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.207595 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.207635 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":81,"threads_started":1}
I20260811 11:05:50.207741 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.203016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36556 (local address 127.25.227.3:34063)
0811 11:05:50.203905 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.203910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.203918 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:50.203951 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.203953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.203971 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.204046 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:50.204168 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.205401 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.206654 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.207362 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.207440 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.207506 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.207609 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.207649 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":856,"thread_start_us":81,"threads_started":1}
I20260811 11:05:50.207674 6388 tablet_service.cc:1467] Processing CreateTablet for tablet d9db09c3fdfd4ece8b38fff1b03e9167 (DEFAULT_TABLE table=test-table [id=02f54b3949a34de691f44de820616a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:50.207937 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.202891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:34073 (local address 127.0.0.1:36076)
0811 11:05:50.203262 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.203341 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.203386 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.203786 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.203787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.203789 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:50.203836 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.203838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.205236 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.205237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.206424 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.206427 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.207714 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.207715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.207784 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.207789 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.207825 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.207866 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":138,"threads_started":1}
I20260811 11:05:50.208073 6388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9db09c3fdfd4ece8b38fff1b03e9167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:50.208308 7108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.202986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36076 (local address 127.25.227.2:34073)
0811 11:05:50.203620 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.203624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.203632 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:50.203668 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.203669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.203682 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.203787 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:50.203923 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.205115 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.206539 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.207618 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.208055 (+ 437us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.208187 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.208210 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.208243 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":84,"threads_started":1}
I20260811 11:05:50.208508 6944 tablet_service.cc:1467] Processing CreateTablet for tablet d9db09c3fdfd4ece8b38fff1b03e9167 (DEFAULT_TABLE table=test-table [id=02f54b3949a34de691f44de820616a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:50.208820 6944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9db09c3fdfd4ece8b38fff1b03e9167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:50.208849 6667 tablet_service.cc:1467] Processing CreateTablet for tablet d9db09c3fdfd4ece8b38fff1b03e9167 (DEFAULT_TABLE table=test-table [id=02f54b3949a34de691f44de820616a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:50.209082 6667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9db09c3fdfd4ece8b38fff1b03e9167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:50.211931 7114 tablet_bootstrap.cc:492] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Bootstrap starting.
I20260811 11:05:50.213157 7114 tablet_bootstrap.cc:654] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:50.213433 7115 tablet_bootstrap.cc:492] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Bootstrap starting.
I20260811 11:05:50.213644 7114 log.cc:824] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:50.214180 7115 tablet_bootstrap.cc:654] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:50.214504 7114 tablet_bootstrap.cc:492] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: No bootstrap required, opened a new log
I20260811 11:05:50.214576 7114 ts_tablet_manager.cc:1397] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:05:50.214602 7115 log.cc:824] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:50.215090 7118 tablet_bootstrap.cc:492] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Bootstrap starting.
I20260811 11:05:50.215808 7115 tablet_bootstrap.cc:492] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: No bootstrap required, opened a new log
I20260811 11:05:50.215879 7115 ts_tablet_manager.cc:1397] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:50.216137 7118 tablet_bootstrap.cc:654] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:50.216840 7118 log.cc:824] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:50.217278 7114 raft_consensus.cc:348] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.217481 7114 raft_consensus.cc:374] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:50.217545 7114 raft_consensus.cc:729] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac0b83cc98144dca2e8f9b6da164dc2, State: Initialized, Role: FOLLOWER
I20260811 11:05:50.217727 7114 consensus_queue.cc:260] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.217979 7118 tablet_bootstrap.cc:492] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: No bootstrap required, opened a new log
I20260811 11:05:50.218052 7118 ts_tablet_manager.cc:1397] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:05:50.218039 7114 ts_tablet_manager.cc:1428] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 11:05:50.218137 6518 heartbeater.cc:503] Master 127.25.227.62:34997 was elected leader, sending a full tablet report...
I20260811 11:05:50.219177 7115 raft_consensus.cc:348] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.219343 7115 raft_consensus.cc:374] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:50.219383 7115 raft_consensus.cc:729] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7046b4981cc84eeeb4f89f38afe08306, State: Initialized, Role: FOLLOWER
I20260811 11:05:50.219497 7115 consensus_queue.cc:260] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.219813 7115 ts_tablet_manager.cc:1428] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 11:05:50.220624 7059 heartbeater.cc:503] Master 127.25.227.62:34997 was elected leader, sending a full tablet report...
I20260811 11:05:50.221285 7118 raft_consensus.cc:348] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.221442 7118 raft_consensus.cc:374] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:50.221481 7118 raft_consensus.cc:729] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c284c232b63421db8f2bf15c256a59e, State: Initialized, Role: FOLLOWER
I20260811 11:05:50.221590 7118 consensus_queue.cc:260] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.221863 7118 ts_tablet_manager.cc:1428] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 11:05:50.221928 6811 heartbeater.cc:503] Master 127.25.227.62:34997 was elected leader, sending a full tablet report...
W20260811 11:05:50.259574 6815 tablet.cc:2369] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:50.289145 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.286799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33642 (local address 127.25.227.60:36121)
0811 11:05:50.286863 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.286865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.286872 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:05:50.286898 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.286898 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.286923 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.286978 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:50.287144 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.287644 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.288514 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.288881 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.288937 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.288992 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.289064 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.289088 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:05:50.289148 7105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.286583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33642)
0811 11:05:50.286660 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.286680 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.286721 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.287012 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.287014 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.287017 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:50.287071 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.287073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.287711 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.287712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.288435 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.288437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.288954 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.288955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.288999 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.289003 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.289043 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.289078 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 11:05:50.289633 6191 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 11:05:50.290555 7131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6104767e4b56401585f0253f4034de79. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:50.290669 7131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: This master's current role is: LEARNER
I20260811 11:05:50.311160 7129 raft_consensus.cc:482] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:50.311295 7129 raft_consensus.cc:504] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.311609 7129 leader_election.cc:288] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063), 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027)
I20260811 11:05:50.314838 7110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.311915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:45055 (local address 127.25.227.3:34063)
0811 11:05:50.311978 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.311981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.312031 (+ 50us) server_negotiation.cc:407] Connection header received
0811 11:05:50.312064 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.312065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.312077 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.312150 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:50.312421 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.312946 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.314086 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.314440 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.314525 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.314534 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.314705 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.314755 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:05:50.314874 7113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.312048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:56797 (local address 127.25.227.1:45027)
0811 11:05:50.312096 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.312098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.312107 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:50.312143 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.312144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.312153 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.312231 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:50.312405 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.312893 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.314129 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.314504 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.314596 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.314605 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.314768 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.314806 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:05:50.314883 6817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.311836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34063 (local address 127.25.227.2:45055)
0811 11:05:50.311910 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.311924 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.311973 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.312184 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.312186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.312188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:50.312337 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.312339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.313033 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.313034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.313997 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.314000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.314522 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.314523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.314596 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.314601 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.314698 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.314735 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 11:05:50.314898 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.311991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:45027 (local address 127.25.227.2:56797)
0811 11:05:50.312051 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:50.312060 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:50.312094 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:50.312235 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:50.312236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:50.312237 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:50.312330 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.312332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.313007 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.313008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.314038 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:50.314041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.314589 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.314590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:50.314671 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.314674 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:50.314742 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 11:05:50.314783 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":45}
I20260811 11:05:50.315498 6978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9db09c3fdfd4ece8b38fff1b03e9167" candidate_uuid: "9c284c232b63421db8f2bf15c256a59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7046b4981cc84eeeb4f89f38afe08306" is_pre_election: true
I20260811 11:05:50.315667 6978 raft_consensus.cc:2454] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c284c232b63421db8f2bf15c256a59e in term 0.
I20260811 11:05:50.315927 6432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9db09c3fdfd4ece8b38fff1b03e9167" candidate_uuid: "9c284c232b63421db8f2bf15c256a59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" is_pre_election: true
I20260811 11:05:50.315946 6573 leader_election.cc:302] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7046b4981cc84eeeb4f89f38afe08306, 9c284c232b63421db8f2bf15c256a59e; no voters:
I20260811 11:05:50.316083 6432 raft_consensus.cc:2454] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c284c232b63421db8f2bf15c256a59e in term 0.
I20260811 11:05:50.316109 7129 raft_consensus.cc:2781] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:50.316180 7129 raft_consensus.cc:482] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:50.316215 7129 raft_consensus.cc:3037] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:50.317072 7129 raft_consensus.cc:504] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.317257 7129 leader_election.cc:288] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [CANDIDATE]: Term 1 election: Requested vote from peers 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063), 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027)
I20260811 11:05:50.317456 6978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9db09c3fdfd4ece8b38fff1b03e9167" candidate_uuid: "9c284c232b63421db8f2bf15c256a59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7046b4981cc84eeeb4f89f38afe08306"
I20260811 11:05:50.317488 6432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9db09c3fdfd4ece8b38fff1b03e9167" candidate_uuid: "9c284c232b63421db8f2bf15c256a59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2"
I20260811 11:05:50.317545 6978 raft_consensus.cc:3037] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:50.317555 6432 raft_consensus.cc:3037] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:50.318675 6978 raft_consensus.cc:2454] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c284c232b63421db8f2bf15c256a59e in term 1.
I20260811 11:05:50.318871 6573 leader_election.cc:302] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7046b4981cc84eeeb4f89f38afe08306, 9c284c232b63421db8f2bf15c256a59e; no voters:
I20260811 11:05:50.318977 7129 raft_consensus.cc:2781] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:50.319096 6432 raft_consensus.cc:2454] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c284c232b63421db8f2bf15c256a59e in term 1.
I20260811 11:05:50.319180 7129 raft_consensus.cc:686] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 1 LEADER]: Becoming Leader. State: Replica: 9c284c232b63421db8f2bf15c256a59e, State: Running, Role: LEADER
I20260811 11:05:50.319285 7129 consensus_queue.cc:237] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } }
I20260811 11:05:50.320346 4690 catalog_manager.cc:5495] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c284c232b63421db8f2bf15c256a59e (127.25.227.2). New cstate: current_term: 1 leader_uuid: "9c284c232b63421db8f2bf15c256a59e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:50.320971 7104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: NON_VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: true } } }
I20260811 11:05:50.321074 7104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:50.321751 7104 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: attempting to promote NON_VOTER 86a9e86941a9484ca5018e80707a64a4 to VOTER
I20260811 11:05:50.321920 7104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } }
I20260811 11:05:50.322454 5837 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Refusing update from remote peer 6104767e4b56401585f0253f4034de79: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 11:05:50.322471 6191 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 LEARNER]: Refusing update from remote peer 6104767e4b56401585f0253f4034de79: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 11:05:50.322703 6126 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 11:05:50.322803 7092 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 11:05:50.323441 7092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.323576 5837 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.323580 6191 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.324311 7092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.324396 7092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:50.324457 7092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.324509 7092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:50.324548 7092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.324584 7092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:50.324671 7146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.324770 7146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:05:50.324853 7131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6104767e4b56401585f0253f4034de79" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:50.324952 7131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:05:50.354311 7108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.351969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36078 (local address 127.25.227.2:34073)
0811 11:05:50.352026 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.352028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.352037 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:50.352081 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.352082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.352099 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.352163 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:50.352304 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.352790 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.353528 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.353783 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.353838 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.353988 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:50.354099 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:50.354186 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.354233 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.354253 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:05:50.356527 6432 raft_consensus.cc:1261] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 FOLLOWER]: Refusing update from remote peer 9c284c232b63421db8f2bf15c256a59e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:50.356539 6978 raft_consensus.cc:1261] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Refusing update from remote peer 9c284c232b63421db8f2bf15c256a59e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:50.356889 7129 consensus_queue.cc:1035] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:50.357030 7139 consensus_queue.cc:1035] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:50.360239 7149 mvcc.cc:205] Tried to move back new op lower bound from 7317284251057508352 to 7317284250908307456. Current Snapshot: MvccSnapshot[applied={T|T < 7317284251057508352}]
I20260811 11:05:50.361577 7148 mvcc.cc:205] Tried to move back new op lower bound from 7317284251057508352 to 7317284250908307456. Current Snapshot: MvccSnapshot[applied={T|T < 7317284251057508352}]
I20260811 11:05:50.364007 4690 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:50.364120 4690 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:50.365505 4690 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6104767e4b56401585f0253f4034de79: Sending DeleteTablet for 3 replicas of tablet d9db09c3fdfd4ece8b38fff1b03e9167
I20260811 11:05:50.365839 6667 tablet_service.cc:1514] Processing DeleteTablet for tablet d9db09c3fdfd4ece8b38fff1b03e9167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:50 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:36076
I20260811 11:05:50.365949 6944 tablet_service.cc:1514] Processing DeleteTablet for tablet d9db09c3fdfd4ece8b38fff1b03e9167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:50 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:36556
I20260811 11:05:50.366092 6388 tablet_service.cc:1514] Processing DeleteTablet for tablet d9db09c3fdfd4ece8b38fff1b03e9167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:50 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:55618
I20260811 11:05:50.366484 7166 tablet_replica.cc:330] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: stopping tablet replica
I20260811 11:05:50.366652 7166 raft_consensus.cc:2229] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:50.366776 7166 raft_consensus.cc:2258] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:50.367238 7166 ts_tablet_manager.cc:1905] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:50.367443 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 4624
I20260811 11:05:50.369452 7167 tablet_replica.cc:330] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: stopping tablet replica
I20260811 11:05:50.369553 7167 raft_consensus.cc:2229] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:50.369638 7167 raft_consensus.cc:2258] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:50.370443 7166 ts_tablet_manager.cc:1918] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:50.370507 7166 log.cc:1196] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/d9db09c3fdfd4ece8b38fff1b03e9167
I20260811 11:05:50.370733 7166 ts_tablet_manager.cc:1939] T d9db09c3fdfd4ece8b38fff1b03e9167 P 9c284c232b63421db8f2bf15c256a59e: Deleting consensus metadata
I20260811 11:05:50.375540 7167 ts_tablet_manager.cc:1905] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:50.377341 7167 ts_tablet_manager.cc:1918] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:50.377480 7167 log.cc:1196] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/d9db09c3fdfd4ece8b38fff1b03e9167
I20260811 11:05:50.377861 7167 ts_tablet_manager.cc:1939] T d9db09c3fdfd4ece8b38fff1b03e9167 P 7046b4981cc84eeeb4f89f38afe08306: Deleting consensus metadata
I20260811 11:05:50.381598 7168 tablet_replica.cc:330] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: stopping tablet replica
I20260811 11:05:50.381743 7168 raft_consensus.cc:2229] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:50.381873 7168 raft_consensus.cc:2258] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:50.382395 7168 ts_tablet_manager.cc:1905] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:50.384001 7168 ts_tablet_manager.cc:1918] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:50.384088 7168 log.cc:1196] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/d9db09c3fdfd4ece8b38fff1b03e9167
I20260811 11:05:50.384378 7168 ts_tablet_manager.cc:1939] T d9db09c3fdfd4ece8b38fff1b03e9167 P 5ac0b83cc98144dca2e8f9b6da164dc2: Deleting consensus metadata
W20260811 11:05:50.385842 6296 connection.cc:535] server connection from 127.0.0.1:55618 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 11:05:50.385872 6568 connection.cc:535] server connection from 127.0.0.1:36076 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 11:05:50.386111 6854 connection.cc:535] server connection from 127.0.0.1:36556 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:05:50.390618 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.367250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33654 (local address 127.25.227.60:36121)
0811 11:05:50.367295 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.367297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.381460 (+ 14163us) server_negotiation.cc:407] Connection header received
0811 11:05:50.381531 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.381532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.381555 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.381634 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.382765 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.383538 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.384891 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.385232 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.385314 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.387007 (+ 1693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.387008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.387009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.387017 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.388974 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.389406 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.389407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.389408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.389482 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.389735 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.389736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.389737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.389867 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.389965 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.390420 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.390495 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:05:50.396139 7086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.388166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.25.227.61:42963)
0811 11:05:50.388211 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.388212 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.388469 (+ 257us) server_negotiation.cc:407] Connection header received
0811 11:05:50.388583 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.388584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.388598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.388629 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.389788 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.390508 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.391648 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.391851 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.391926 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.393343 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.393345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.393345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.393352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.394959 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.395331 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.395332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.395333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.395396 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.395608 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.395609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.395610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.395751 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.395844 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.395940 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.396018 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:05:50.396672 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:50.388016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33668 (local address 127.25.227.60:36121)
0811 11:05:50.388071 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:50.388073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:50.388473 (+ 400us) server_negotiation.cc:407] Connection header received
0811 11:05:50.388567 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:50.388568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:50.388583 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:50.388614 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:50.389726 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.390487 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.391677 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:50.391986 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:50.392025 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:50.393660 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:50.393662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:50.393662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:50.393669 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:50.395346 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.395719 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.395720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.395720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.395778 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:50.395992 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:50.395993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:50.395993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:50.396110 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:50.396179 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:50.396495 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 11:05:50.396589 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:05:51.361362 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.361005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:40389)
0811 11:05:51.361156 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.361285 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
W20260811 11:05:51.361742 6518 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:34997 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.362156 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.361888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.2:57513)
0811 11:05:51.362016 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.362105 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":58,"threads_started":1}
I20260811 11:05:51.362464 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.362214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:57325)
0811 11:05:51.362326 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.362420 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
W20260811 11:05:51.362536 6811 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:34997 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
W20260811 11:05:51.362746 7059 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:34997 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.865741 7192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6104767e4b56401585f0253f4034de79)
I20260811 11:05:51.865914 7192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } }
I20260811 11:05:51.866223 7192 leader_election.cc:288] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997), 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60:36121)
I20260811 11:05:51.866776 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.866389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42080)
0811 11:05:51.866597 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.866675 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":56,"threads_started":1}
W20260811 11:05:51.866958 5791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.866981 7197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6104767e4b56401585f0253f4034de79)
I20260811 11:05:51.867110 7197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } }
I20260811 11:05:51.867401 7197 leader_election.cc:288] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997), 068cbebe5d19479cb993f56d3c5be141 (127.25.227.61:42963)
I20260811 11:05:51.867419 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.867319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42092)
0811 11:05:51.867357 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.867386 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 11:05:51.867763 5791 leader_election.cc:334] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997): Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.867990 7204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.867488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42100)
0811 11:05:51.867885 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.867946 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":63,"threads_started":1}
W20260811 11:05:51.868104 6163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.868546 7204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.868457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42104)
0811 11:05:51.868490 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.868515 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 11:05:51.868675 6163 leader_election.cc:334] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997): Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.870273 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.866403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:36121 (local address 127.0.0.1:33684)
0811 11:05:51.866672 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.866683 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:51.866776 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:51.867134 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:51.867135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:51.867139 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:51.867206 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.867208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.868192 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.868194 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.869406 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.869409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.870101 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.870102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.870146 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.870150 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:51.870190 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 11:05:51.870225 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":1,"thread_start_us":46,"threads_started":1}
I20260811 11:05:51.870314 7196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.866762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.25.227.60:36121)
0811 11:05:51.866960 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:51.866962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:51.866971 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:51.867003 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:51.867004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:51.867017 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:51.867082 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:51.867324 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.868105 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.869474 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.870019 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.870098 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.870110 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:51.870214 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 11:05:51.870252 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":102,"threads_started":1}
I20260811 11:05:51.870675 6191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "068cbebe5d19479cb993f56d3c5be141" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "86a9e86941a9484ca5018e80707a64a4" is_pre_election: true
I20260811 11:05:51.870798 6191 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 068cbebe5d19479cb993f56d3c5be141 in term 1.
I20260811 11:05:51.871011 5794 leader_election.cc:302] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068cbebe5d19479cb993f56d3c5be141, 86a9e86941a9484ca5018e80707a64a4; no voters: 6104767e4b56401585f0253f4034de79
I20260811 11:05:51.871147 7192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 11:05:51.871199 7192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6104767e4b56401585f0253f4034de79)
I20260811 11:05:51.871255 7192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:05:51.871280 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.867647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:42963 (local address 127.0.0.1:41854)
0811 11:05:51.867960 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.867971 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:51.868112 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:51.868314 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:51.868316 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:51.868318 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:51.868361 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.868362 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.869259 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.869260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.870394 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.870397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.871004 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.871006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.871079 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.871083 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:51.871143 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 11:05:51.871191 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":61,"threads_started":1}
I20260811 11:05:51.871476 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.867737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41854 (local address 127.25.227.61:42963)
0811 11:05:51.867944 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:51.867946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:51.868019 (+ 73us) server_negotiation.cc:407] Connection header received
0811 11:05:51.868219 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:51.868221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:51.868231 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:51.868301 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:51.868437 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.869140 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.870491 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.870928 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.870994 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.871005 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:51.871377 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 11:05:51.871423 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":99,"threads_started":1}
I20260811 11:05:51.871703 5837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86a9e86941a9484ca5018e80707a64a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "068cbebe5d19479cb993f56d3c5be141" is_pre_election: true
I20260811 11:05:51.872190 7192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } }
I20260811 11:05:51.872339 5837 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86a9e86941a9484ca5018e80707a64a4 in current term 2: Already voted for candidate 068cbebe5d19479cb993f56d3c5be141 in this term.
I20260811 11:05:51.872360 7192 leader_election.cc:288] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [CANDIDATE]: Term 2 election: Requested vote from peers 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997), 86a9e86941a9484ca5018e80707a64a4 (127.25.227.60:36121)
I20260811 11:05:51.872510 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.872433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42114)
0811 11:05:51.872464 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.872489 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 11:05:51.872570 6163 leader_election.cc:302] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86a9e86941a9484ca5018e80707a64a4; no voters: 068cbebe5d19479cb993f56d3c5be141, 6104767e4b56401585f0253f4034de79
I20260811 11:05:51.872581 6191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "068cbebe5d19479cb993f56d3c5be141" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "86a9e86941a9484ca5018e80707a64a4"
I20260811 11:05:51.872696 6191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:05:51.872864 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.872737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42120)
0811 11:05:51.872814 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.872840 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 11:05:51.872959 5791 leader_election.cc:334] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997): Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
I20260811 11:05:51.873492 6191 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 068cbebe5d19479cb993f56d3c5be141 in term 2.
I20260811 11:05:51.873576 7197 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:05:51.873664 5794 leader_election.cc:302] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 068cbebe5d19479cb993f56d3c5be141, 86a9e86941a9484ca5018e80707a64a4; no voters: 6104767e4b56401585f0253f4034de79
I20260811 11:05:51.873795 7192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:05:51.873950 7192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [term 2 LEADER]: Becoming Leader. State: Replica: 068cbebe5d19479cb993f56d3c5be141, State: Running, Role: LEADER
I20260811 11:05:51.874032 7192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } }
I20260811 11:05:51.874387 7215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 068cbebe5d19479cb993f56d3c5be141. Latest consensus state: current_term: 2 leader_uuid: "068cbebe5d19479cb993f56d3c5be141" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:51.874469 7215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:51.874658 7218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:51.875057 7218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:51.875160 7218 catalog_manager.cc:1259] Loaded cluster ID: 173f64e75d5847fa964b9069f04c09ba
I20260811 11:05:51.875265 7218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:51.875434 7218 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:51.875536 7218 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Loaded TSK: 0
I20260811 11:05:51.875679 7218 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:05:51.882207 5819 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:51.883705 5819 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:51.884568 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.884482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42138)
0811 11:05:51.884513 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.884539 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 11:05:51.884577 6191 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [term 2 FOLLOWER]: Refusing update from remote peer 068cbebe5d19479cb993f56d3c5be141: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 11:05:51.884826 7215 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 11:05:51.884922 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.884846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.0.0.1:42150)
0811 11:05:51.884875 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.884901 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 11:05:51.885141 5791 consensus_peers.cc:487] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 -> Peer 6104767e4b56401585f0253f4034de79 (127.25.227.62:34997): Couldn't send request to peer 6104767e4b56401585f0253f4034de79. Status: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 11:05:51.885532 7197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 068cbebe5d19479cb993f56d3c5be141. Latest consensus state: current_term: 2 leader_uuid: "068cbebe5d19479cb993f56d3c5be141" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:51.885625 7197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:05:51.886130 7215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "068cbebe5d19479cb993f56d3c5be141" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:51.886227 7215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:51.886209 7197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "068cbebe5d19479cb993f56d3c5be141" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "6104767e4b56401585f0253f4034de79" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34997 } } peers { permanent_uuid: "068cbebe5d19479cb993f56d3c5be141" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 42963 } attrs { promote: false } } peers { permanent_uuid: "86a9e86941a9484ca5018e80707a64a4" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 36121 } attrs { promote: false } } }
I20260811 11:05:51.886287 7197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a9e86941a9484ca5018e80707a64a4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:05:51.886389 7221 mvcc.cc:205] Tried to move back new op lower bound from 7317284257317572608 to 7317284257276727296. Current Snapshot: MvccSnapshot[applied={T|T < 7317284257317572608 or (T in {7317284257317572608})}]
I20260811 11:05:51.891466 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.888082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55624 (local address 127.25.227.1:45027)
0811 11:05:51.888654 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:51.888656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:51.888664 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:51.888688 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:51.888689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:51.888699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:51.888784 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:51.888892 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.889616 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.890613 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.891156 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.891229 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.891241 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:51.891339 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 11:05:51.891391 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":79,"threads_started":1}
I20260811 11:05:51.891464 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.888012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:45027 (local address 127.0.0.1:55624)
0811 11:05:51.888127 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.888138 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:51.888184 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:51.888792 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:51.888793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:51.888795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:51.888829 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.888831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.889691 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.889692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.890545 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.890547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.891237 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.891238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.891283 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.891286 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:51.891333 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 11:05:51.891389 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":64}
I20260811 11:05:51.892058 6388 tablet_service.cc:1467] Processing CreateTablet for tablet 0593e12b43fe40da8a1b1c13f90ccbeb (DEFAULT_TABLE table=test-table [id=3b7eba47b28d42c4a1dfade42e771814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:51.892251 6388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0593e12b43fe40da8a1b1c13f90ccbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:51.892510 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.888085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:34073 (local address 127.0.0.1:36086)
0811 11:05:51.888201 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.888210 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:51.888254 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:51.888477 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:51.888478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:51.888479 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:51.888526 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.888527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.889503 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.889504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.890727 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.890731 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.892189 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.892190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.892277 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.892284 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:05:51.892343 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:05:51.892395 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":54}
I20260811 11:05:51.892684 7241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.888102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34063 (local address 127.0.0.1:36564)
0811 11:05:51.888490 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.888499 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:51.888554 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:51.888716 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:51.888717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:51.888719 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:51.888759 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.888761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.889517 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.889518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.890734 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:51.890736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.892293 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.892294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:51.892367 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.892372 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:51.892417 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 11:05:51.892458 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":42,"thread_start_us":64,"threads_started":1}
I20260811 11:05:51.892704 7243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.888199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.25.227.2:34073)
0811 11:05:51.888324 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:51.888326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:51.888334 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:51.888362 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:51.888363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:51.888376 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:51.888596 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:51.888640 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.889415 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.891548 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.892071 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.892177 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.892191 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:51.892601 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 11:05:51.892644 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":77,"threads_started":1}
I20260811 11:05:51.892848 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.888335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.25.227.3:34063)
0811 11:05:51.888441 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:51.888443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:51.888589 (+ 146us) server_negotiation.cc:407] Connection header received
0811 11:05:51.888624 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:51.888625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:51.888637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:51.888702 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:51.888835 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.889434 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.890818 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:51.891440 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:51.892250 (+ 810us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:51.892264 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:51.892534 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 11:05:51.892780 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":55,"threads_started":1}
I20260811 11:05:51.892870 6667 tablet_service.cc:1467] Processing CreateTablet for tablet 0593e12b43fe40da8a1b1c13f90ccbeb (DEFAULT_TABLE table=test-table [id=3b7eba47b28d42c4a1dfade42e771814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:51.892982 6667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0593e12b43fe40da8a1b1c13f90ccbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:51.893695 6944 tablet_service.cc:1467] Processing CreateTablet for tablet 0593e12b43fe40da8a1b1c13f90ccbeb (DEFAULT_TABLE table=test-table [id=3b7eba47b28d42c4a1dfade42e771814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:51.893855 6944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0593e12b43fe40da8a1b1c13f90ccbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:51.894227 7246 tablet_bootstrap.cc:492] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2: Bootstrap starting.
I20260811 11:05:51.894784 7246 tablet_bootstrap.cc:654] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:51.895057 7247 tablet_bootstrap.cc:492] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Bootstrap starting.
I20260811 11:05:51.895428 7246 tablet_bootstrap.cc:492] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2: No bootstrap required, opened a new log
I20260811 11:05:51.895474 7246 ts_tablet_manager.cc:1397] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:51.895568 7247 tablet_bootstrap.cc:654] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:51.895614 7246 raft_consensus.cc:348] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:51.895705 7246 raft_consensus.cc:374] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:51.895737 7246 raft_consensus.cc:729] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac0b83cc98144dca2e8f9b6da164dc2, State: Initialized, Role: FOLLOWER
I20260811 11:05:51.895797 7246 consensus_queue.cc:260] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:51.895881 7253 tablet_bootstrap.cc:492] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Bootstrap starting.
I20260811 11:05:51.895973 7246 ts_tablet_manager.cc:1428] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:51.896183 7247 tablet_bootstrap.cc:492] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: No bootstrap required, opened a new log
I20260811 11:05:51.896231 7247 ts_tablet_manager.cc:1397] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:51.896394 7253 tablet_bootstrap.cc:654] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:51.896373 7247 raft_consensus.cc:348] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:51.896442 7247 raft_consensus.cc:374] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:51.896454 7256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.896227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:39435)
0811 11:05:51.896372 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.896413 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260811 11:05:51.896468 7247 raft_consensus.cc:729] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c284c232b63421db8f2bf15c256a59e, State: Initialized, Role: FOLLOWER
I20260811 11:05:51.896514 7247 consensus_queue.cc:260] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:51.896651 7247 ts_tablet_manager.cc:1428] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:51.897249 7265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.897001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.2:52629)
0811 11:05:51.897151 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.897207 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260811 11:05:51.897109 7253 tablet_bootstrap.cc:492] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: No bootstrap required, opened a new log
I20260811 11:05:51.897514 7253 ts_tablet_manager.cc:1397] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:51.897677 6519 heartbeater.cc:503] Master 127.25.227.61:42963 was elected leader, sending a full tablet report...
I20260811 11:05:51.897680 7253 raft_consensus.cc:348] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:51.897749 7253 raft_consensus.cc:374] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:51.897743 7256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.897599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:48969)
0811 11:05:51.897641 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.897674 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 11:05:51.897766 7253 raft_consensus.cc:729] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7046b4981cc84eeeb4f89f38afe08306, State: Initialized, Role: FOLLOWER
I20260811 11:05:51.897957 7253 consensus_queue.cc:260] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:51.898173 7253 ts_tablet_manager.cc:1428] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 11:05:51.898563 7269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.898344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:43215)
0811 11:05:51.898485 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.898525 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260811 11:05:51.898741 7060 heartbeater.cc:503] Master 127.25.227.61:42963 was elected leader, sending a full tablet report...
I20260811 11:05:51.899121 7269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:51.899037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:53331)
0811 11:05:51.899068 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:51.899097 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 11:05:51.928840 7061 tablet.cc:2369] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:05:52.111081 6520 tablet.cc:2369] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:52.196164 7255 raft_consensus.cc:482] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:52.196270 7255 raft_consensus.cc:504] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:52.196585 7255 leader_election.cc:288] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063), 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073)
I20260811 11:05:52.199826 7243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.196956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:36123 (local address 127.25.227.2:34073)
0811 11:05:52.197002 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:52.197004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:52.197132 (+ 128us) server_negotiation.cc:407] Connection header received
0811 11:05:52.197217 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:52.197218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:52.197230 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:52.197283 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:52.197493 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.197976 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.198935 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.199477 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.199544 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:52.199555 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:52.199708 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 11:05:52.199752 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:05:52.199826 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.196893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:39303 (local address 127.25.227.3:34063)
0811 11:05:52.196974 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:52.196976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:52.196991 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:05:52.197028 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:52.197029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:52.197040 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:52.197112 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:52.197375 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.197902 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.198891 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.199437 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.199515 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:52.199529 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:52.199709 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 11:05:52.199751 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:05:52.199868 7256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.196797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34063 (local address 127.25.227.1:39303)
0811 11:05:52.196874 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.196889 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:52.196964 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:52.197156 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:52.197157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:52.197160 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:52.197295 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:52.197297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.197984 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.197985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:52.198795 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:52.198798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.199539 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.199540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:52.199613 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:52.199618 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:52.199681 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 11:05:52.199726 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":3}
I20260811 11:05:52.199880 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.196797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:34073 (local address 127.25.227.1:36123)
0811 11:05:52.197048 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.197058 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:52.197115 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:52.197325 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:52.197325 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:52.197327 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:52.197415 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:52.197416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.198069 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.198070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:52.198860 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:52.198863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.199568 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.199569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:52.199632 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:52.199636 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:52.199689 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 11:05:52.199726 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":24,"thread_start_us":143,"threads_started":1}
I20260811 11:05:52.200186 6978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593e12b43fe40da8a1b1c13f90ccbeb" candidate_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7046b4981cc84eeeb4f89f38afe08306" is_pre_election: true
I20260811 11:05:52.200311 6978 raft_consensus.cc:2454] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac0b83cc98144dca2e8f9b6da164dc2 in term 0.
I20260811 11:05:52.200431 6712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593e12b43fe40da8a1b1c13f90ccbeb" candidate_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c284c232b63421db8f2bf15c256a59e" is_pre_election: true
I20260811 11:05:52.200580 6712 raft_consensus.cc:2454] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ac0b83cc98144dca2e8f9b6da164dc2 in term 0.
I20260811 11:05:52.200575 6298 leader_election.cc:302] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac0b83cc98144dca2e8f9b6da164dc2, 7046b4981cc84eeeb4f89f38afe08306; no voters:
I20260811 11:05:52.200727 7255 raft_consensus.cc:2781] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:52.200779 7255 raft_consensus.cc:482] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:52.200800 7255 raft_consensus.cc:3037] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:52.201524 7255 raft_consensus.cc:504] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:52.201674 7255 leader_election.cc:288] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [CANDIDATE]: Term 1 election: Requested vote from peers 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063), 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073)
I20260811 11:05:52.201872 6712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593e12b43fe40da8a1b1c13f90ccbeb" candidate_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c284c232b63421db8f2bf15c256a59e"
I20260811 11:05:52.201956 6712 raft_consensus.cc:3037] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:52.201898 6978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0593e12b43fe40da8a1b1c13f90ccbeb" candidate_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7046b4981cc84eeeb4f89f38afe08306"
I20260811 11:05:52.201999 6978 raft_consensus.cc:3037] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:52.202634 6978 raft_consensus.cc:2454] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac0b83cc98144dca2e8f9b6da164dc2 in term 1.
I20260811 11:05:52.202697 6712 raft_consensus.cc:2454] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ac0b83cc98144dca2e8f9b6da164dc2 in term 1.
I20260811 11:05:52.202848 6298 leader_election.cc:302] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ac0b83cc98144dca2e8f9b6da164dc2, 7046b4981cc84eeeb4f89f38afe08306; no voters:
I20260811 11:05:52.202962 7255 raft_consensus.cc:2781] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:52.203135 7255 raft_consensus.cc:686] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [term 1 LEADER]: Becoming Leader. State: Replica: 5ac0b83cc98144dca2e8f9b6da164dc2, State: Running, Role: LEADER
I20260811 11:05:52.203222 7255 consensus_queue.cc:237] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } }
I20260811 11:05:52.203616 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.203497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:48511)
0811 11:05:52.203536 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.203571 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 11:05:52.204054 5819 catalog_manager.cc:5495] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1). New cstate: current_term: 1 leader_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ac0b83cc98144dca2e8f9b6da164dc2" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 45027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:52.244161 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.241989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.25.227.1:45027)
0811 11:05:52.242067 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:52.242068 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:52.242076 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:52.242115 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:52.242116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:52.242136 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:52.242197 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:52.242323 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.242792 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.243525 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:52.243721 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:52.243781 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:52.243896 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:52.243994 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:52.244044 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:52.244081 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 11:05:52.244099 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:05:52.245555 6978 raft_consensus.cc:1261] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Refusing update from remote peer 5ac0b83cc98144dca2e8f9b6da164dc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:52.245581 6712 raft_consensus.cc:1261] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Refusing update from remote peer 5ac0b83cc98144dca2e8f9b6da164dc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:52.245923 7255 consensus_queue.cc:1035] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c284c232b63421db8f2bf15c256a59e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:52.246104 7272 consensus_queue.cc:1035] T 0593e12b43fe40da8a1b1c13f90ccbeb P 5ac0b83cc98144dca2e8f9b6da164dc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7046b4981cc84eeeb4f89f38afe08306" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:52.246941 6814 heartbeater.cc:503] Master 127.25.227.61:42963 was elected leader, sending a full tablet report...
I20260811 11:05:52.247315 7269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.247175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:39437)
0811 11:05:52.247221 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.247262 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 11:05:52.248206 7265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.248103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.2:33709)
0811 11:05:52.248142 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.248171 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 11:05:52.249269 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.249056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:43257)
0811 11:05:52.249189 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.249233 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 11:05:52.249452 7265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.249318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.2:46491)
0811 11:05:52.249396 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.249425 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 11:05:52.250483 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.249945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.1:46049)
0811 11:05:52.250425 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.250457 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466}
I20260811 11:05:52.250715 7281 mvcc.cc:205] Tried to move back new op lower bound from 7317284258794860544 to 7317284258624892928. Current Snapshot: MvccSnapshot[applied={T|T < 7317284258794860544 or (T in {7317284258794860544})}]
I20260811 11:05:52.251158 7269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.251065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:34997 (local address 127.25.227.3:46651)
0811 11:05:52.251108 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.251137 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:34997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 11:05:52.251564 5819 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:52.251654 5819 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:52.253021 5819 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 068cbebe5d19479cb993f56d3c5be141: Sending DeleteTablet for 3 replicas of tablet 0593e12b43fe40da8a1b1c13f90ccbeb
I20260811 11:05:52.253355 6944 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593e12b43fe40da8a1b1c13f90ccbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:52 UTC) from {username='oryx', principal='oryx/127.25.227.61@KRBTEST.COM'} at 127.0.0.1:36564
I20260811 11:05:52.253358 6667 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593e12b43fe40da8a1b1c13f90ccbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:52 UTC) from {username='oryx', principal='oryx/127.25.227.61@KRBTEST.COM'} at 127.0.0.1:36086
I20260811 11:05:52.253615 6388 tablet_service.cc:1514] Processing DeleteTablet for tablet 0593e12b43fe40da8a1b1c13f90ccbeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:52 UTC) from {username='oryx', principal='oryx/127.25.227.61@KRBTEST.COM'} at 127.0.0.1:55624
I20260811 11:05:52.253662 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 6120
I20260811 11:05:52.253810 7299 tablet_replica.cc:330] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: stopping tablet replica
I20260811 11:05:52.253867 7299 raft_consensus.cc:2229] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:52.253912 7299 raft_consensus.cc:2258] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:52.254071 7301 tablet_replica.cc:330] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: stopping tablet replica
I20260811 11:05:52.254124 7301 raft_consensus.cc:2229] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:52.254166 7301 raft_consensus.cc:2258] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:52.262629 7299 ts_tablet_manager.cc:1905] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:52.264648 7299 ts_tablet_manager.cc:1918] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:52.264739 7299 log.cc:1196] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/0593e12b43fe40da8a1b1c13f90ccbeb
I20260811 11:05:52.265069 7299 ts_tablet_manager.cc:1939] T 0593e12b43fe40da8a1b1c13f90ccbeb P 9c284c232b63421db8f2bf15c256a59e: Deleting consensus metadata
I20260811 11:05:52.266594 5794 catalog_manager.cc:4841] TS 9c284c232b63421db8f2bf15c256a59e (127.25.227.2:34073): tablet 0593e12b43fe40da8a1b1c13f90ccbeb (table test-table [id=3b7eba47b28d42c4a1dfade42e771814]) successfully deleted
I20260811 11:05:52.267982 7301 ts_tablet_manager.cc:1905] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:52.269431 7301 ts_tablet_manager.cc:1918] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:52.269495 7301 log.cc:1196] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/0593e12b43fe40da8a1b1c13f90ccbeb
I20260811 11:05:52.269717 7301 ts_tablet_manager.cc:1939] T 0593e12b43fe40da8a1b1c13f90ccbeb P 7046b4981cc84eeeb4f89f38afe08306: Deleting consensus metadata
I20260811 11:05:52.270258 5795 catalog_manager.cc:4841] TS 7046b4981cc84eeeb4f89f38afe08306 (127.25.227.3:34063): tablet 0593e12b43fe40da8a1b1c13f90ccbeb (table test-table [id=3b7eba47b28d42c4a1dfade42e771814]) successfully deleted
I20260811 11:05:52.275216 7241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:52.275088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:45027 (local address 127.0.0.1:55648)
0811 11:05:52.275149 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:52.275184 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:45027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:05:52.275355 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 6529
W20260811 11:05:52.275457 5795 catalog_manager.cc:4584] TS 5ac0b83cc98144dca2e8f9b6da164dc2 (127.25.227.1:45027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0593e12b43fe40da8a1b1c13f90ccbeb: Network error: Client connection negotiation failed: client connection to 127.25.227.1:45027: connect: Connection refused (error 111)
I20260811 11:05:52.295171 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 6820
I20260811 11:05:52.309381 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 5571
I20260811 11:05:52.325033 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 5926
2026-08-11T11:05:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5399 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:52 dist-test-slave-z8x9 krb5kdc[7307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:52 dist-test-slave-z8x9 krb5kdc[7307](info): set up 2 sockets
Aug 11 11:05:52 dist-test-slave-z8x9 krb5kdc[7307](info): commencing operation
krb5kdc: starting...
W20260811 11:05:53.634574 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:53 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab.
Entry for principal oryx/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab.
I20260811 11:05:53.755867 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43583
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab
--principal=oryx/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:43583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:53.838805 7328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:53.839067 7328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:53.839103 7328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:53.840240 7328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:53.840309 7328 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 11:05:53.840332 7328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:53.840353 7328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:53.840385 7328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:53.840409 7328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:53.842001 7328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:43583
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.62.keytab
--principal=oryx/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:53.842290 7328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:53.842530 7328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:53.847514 7342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:53.847558 7328 server_base.cc:1034] running on GCE node
W20260811 11:05:53.847524 7345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:53.847576 7343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:53.848064 7328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:53.848394 7328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:53.849529 7328 hybrid_clock.cc:648] HybridClock initialized: now 1786446353849510 us; error 39 us; skew 500 ppm
Aug 11 11:05:53 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446353, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:53.857679 7328 init.cc:377] Logged in from keytab as oryx/127.25.227.62@KRBTEST.COM (short username oryx)
I20260811 11:05:53.858122 7328 webserver.cc:460] Webserver started at http://127.25.227.62:40785/ using document root <none> and password file <none>
I20260811 11:05:53.858352 7328 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:53.858397 7328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:53.858572 7328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:53.859705 7328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "e6a491066a3a4e34837950ee09a04474"
format_stamp: "Formatted at 2026-08-11 11:05:53 on dist-test-slave-z8x9"
server_key: "3214a6523afdb5890aa894bad0b3b877"
server_key_iv: "260f5cff1c2c0454528f4bb631d84a9d"
server_key_version: "encryptionkey@0"
I20260811 11:05:53.860153 7328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "e6a491066a3a4e34837950ee09a04474"
format_stamp: "Formatted at 2026-08-11 11:05:53 on dist-test-slave-z8x9"
server_key: "3214a6523afdb5890aa894bad0b3b877"
server_key_iv: "260f5cff1c2c0454528f4bb631d84a9d"
server_key_version: "encryptionkey@0"
I20260811 11:05:53.861564 7328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:53.862315 7357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:53.862493 7328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:53.862587 7328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "e6a491066a3a4e34837950ee09a04474"
format_stamp: "Formatted at 2026-08-11 11:05:53 on dist-test-slave-z8x9"
server_key: "3214a6523afdb5890aa894bad0b3b877"
server_key_iv: "260f5cff1c2c0454528f4bb631d84a9d"
server_key_version: "encryptionkey@0"
I20260811 11:05:53.862663 7328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:53.880614 7328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:53.882603 7328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:53.882773 7328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:53.887645 7328 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:43583
I20260811 11:05:53.887698 7470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:43583 every 8 connection(s)
I20260811 11:05:53.888028 7328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:53.888695 7472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:53.890882 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 7328
I20260811 11:05:53.890987 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:53.891196 26508 external_mini_cluster.cc:1428] Setting key 183e8c7810d79fa32082be90fa99925d
I20260811 11:05:53.891278 7472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Bootstrap starting.
I20260811 11:05:53.891990 7472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:53.892331 7472 log.cc:824] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:53.893050 7472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: No bootstrap required, opened a new log
I20260811 11:05:53.895215 7472 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a491066a3a4e34837950ee09a04474" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43583 } }
I20260811 11:05:53.895401 7472 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:53.895453 7472 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a491066a3a4e34837950ee09a04474, State: Initialized, Role: FOLLOWER
I20260811 11:05:53.895593 7472 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a491066a3a4e34837950ee09a04474" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43583 } }
I20260811 11:05:53.895678 7472 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:53.895725 7472 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:53.895774 7472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:53.896313 7472 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a491066a3a4e34837950ee09a04474" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43583 } }
I20260811 11:05:53.896436 7472 leader_election.cc:302] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6a491066a3a4e34837950ee09a04474; no voters:
I20260811 11:05:53.896612 7472 leader_election.cc:288] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:53.896713 7478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:53.896893 7472 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:53.896977 7478 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [term 1 LEADER]: Becoming Leader. State: Replica: e6a491066a3a4e34837950ee09a04474, State: Running, Role: LEADER
I20260811 11:05:53.897090 7478 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a491066a3a4e34837950ee09a04474" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43583 } }
I20260811 11:05:53.897537 7478 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6a491066a3a4e34837950ee09a04474. Latest consensus state: current_term: 1 leader_uuid: "e6a491066a3a4e34837950ee09a04474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a491066a3a4e34837950ee09a04474" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43583 } } }
I20260811 11:05:53.897624 7478 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:53.897553 7479 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6a491066a3a4e34837950ee09a04474" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a491066a3a4e34837950ee09a04474" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43583 } } }
I20260811 11:05:53.897662 7479 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474 [sys.catalog]: This master's current role is: LEADER
Aug 11 11:05:53 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
W20260811 11:05:53.898826 7501 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:05:53.898875 7501 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:05:53.898932 7492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:53.899078 7492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:53.900701 7492 catalog_manager.cc:1347] Generated new cluster ID: 7e3c2895841d44db8a29b94b214d372f
I20260811 11:05:53.900767 7492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:53.903141 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:53.891755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41506 (local address 127.25.227.62:43583)
0811 11:05:53.891940 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:53.891950 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:53.891988 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:05:53.892508 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:53.892516 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:53.892565 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:53.892715 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:53.893438 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:53.894556 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:53.895372 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:53.895982 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:53.896115 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:53.899242 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:53.899247 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:53.899248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:53.899261 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:53.901368 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:53.901757 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:53.901760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:53.901761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:53.901875 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:53.902085 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:53.902086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:53.902086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:53.902405 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:53.902583 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:53.902733 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 11:05:53.902885 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260811 11:05:53.911428 7492 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:53.912210 7492 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:53.916080 7492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Generated new TSK 0
I20260811 11:05:53.916257 7492 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab.
Entry for principal oryx/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab.
I20260811 11:05:53.941880 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43583
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:54.024991 7512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:54.025250 7512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:54.025277 7512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:54.026563 7512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:54.026605 7512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:54.026626 7512 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:54.026644 7512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:54.028165 7512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:43583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:54.028398 7512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:54.028636 7512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:54.033941 7519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:54.033974 7534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:54.033968 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:54.034009 7512 server_base.cc:1034] running on GCE node
I20260811 11:05:54.034377 7512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:54.034631 7512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:54.035794 7512 hybrid_clock.cc:648] HybridClock initialized: now 1786446354035787 us; error 37 us; skew 500 ppm
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:54.038527 7512 init.cc:377] Logged in from keytab as oryx/127.25.227.1@KRBTEST.COM (short username oryx)
I20260811 11:05:54.038987 7512 webserver.cc:460] Webserver started at http://127.25.227.1:36651/ using document root <none> and password file <none>
I20260811 11:05:54.039168 7512 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:54.039211 7512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:54.039304 7512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:54.040300 7512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "3ccd15ea8b5d42c98221248ec06dc556"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "91f7d9b1846aeed8358b9e3049f9cc0f"
server_key_iv: "33b9405997d0ba18bc38f54882bdc832"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.040606 7512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "3ccd15ea8b5d42c98221248ec06dc556"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "91f7d9b1846aeed8358b9e3049f9cc0f"
server_key_iv: "33b9405997d0ba18bc38f54882bdc832"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.041985 7512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:54.042678 7543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.042871 7512 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:54.042970 7512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "3ccd15ea8b5d42c98221248ec06dc556"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "91f7d9b1846aeed8358b9e3049f9cc0f"
server_key_iv: "33b9405997d0ba18bc38f54882bdc832"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.043052 7512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:54.056169 7512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:54.058127 7512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:54.058290 7512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:54.058802 7512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:54.058869 7512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.058911 7512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:54.058935 7512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.065980 7512 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:46407
I20260811 11:05:54.066047 7764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:46407 every 8 connection(s)
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:54.066421 7512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:54.066963 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 7512
I20260811 11:05:54.067104 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:54.067322 26508 external_mini_cluster.cc:1428] Setting key bbddf39bae40c4f21fa1b41a63d3e625
I20260811 11:05:54.070171 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.059344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:34383 (local address 127.25.227.62:43583)
0811 11:05:54.059400 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.059403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.059577 (+ 174us) server_negotiation.cc:407] Connection header received
0811 11:05:54.060057 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.060059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.060075 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.060157 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.061064 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.061929 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.063510 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.063900 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.063981 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.066736 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.066738 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.066738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.066754 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.068722 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.069124 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.069126 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.069126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.069218 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.069453 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.069454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.069455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.069613 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.069682 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.069969 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.070072 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 11:05:54.070349 7563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.059287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.25.227.1:34383)
0811 11:05:54.059441 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.059482 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.059963 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.060277 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.060282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.060679 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.060955 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.060962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.062035 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.062036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.063428 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.063431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.063983 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.063984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.064084 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.064619 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.064630 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.066619 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.068827 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.068833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.068835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.069052 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.069280 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.069284 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.069285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.069386 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.069679 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.069685 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.069796 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.069940 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.070096 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260811 11:05:54.071023 7766 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43583
I20260811 11:05:54.071113 7766 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:54.071305 7766 heartbeater.cc:511] Master 127.25.227.62:43583 requested a full tablet report, sending...
I20260811 11:05:54.071851 7385 ts_manager.cc:194] Registered new tserver with Master: 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407)
I20260811 11:05:54.072700 7385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:34383
I20260811 11:05:54.078459 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.072210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:36877 (local address 127.25.227.62:43583)
0811 11:05:54.072257 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.072258 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.072282 (+ 24us) server_negotiation.cc:407] Connection header received
0811 11:05:54.072350 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.072351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.072362 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.072410 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.072818 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.073610 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.074646 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.074828 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.074883 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.075931 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.075932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.075932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.075938 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.077344 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.077718 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.077718 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.077719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.077783 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.078000 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.078001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.078001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.078094 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.078143 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.078340 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.078402 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:05:54.078544 7774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.072057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.25.227.1:36877)
0811 11:05:54.072210 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.072222 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.072279 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.072415 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.072416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.072644 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.072719 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.072721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.073729 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.073730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.074563 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.074566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.074911 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.074912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.074990 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.075406 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.075412 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.075835 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.077421 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.077423 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.077423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.077643 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.077851 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.077853 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.077853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.077931 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.078163 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.078165 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.078223 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.078317 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.078425 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for oryx/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab.
Entry for principal oryx/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab.
I20260811 11:05:54.096176 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43583
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:54.180857 7777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:54.181106 7777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:54.181147 7777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:54.182304 7777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:54.182374 7777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:54.182410 7777 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:54.182469 7777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:54.184003 7777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:43583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:54.184269 7777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:54.184510 7777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:54.189901 7791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:54.189857 7788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:54.189859 7789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:54.190228 7777 server_base.cc:1034] running on GCE node
I20260811 11:05:54.190475 7777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:54.190713 7777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:54.191895 7777 hybrid_clock.cc:648] HybridClock initialized: now 1786446354191887 us; error 37 us; skew 500 ppm
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:54.194556 7777 init.cc:377] Logged in from keytab as oryx/127.25.227.2@KRBTEST.COM (short username oryx)
I20260811 11:05:54.194991 7777 webserver.cc:460] Webserver started at http://127.25.227.2:40171/ using document root <none> and password file <none>
I20260811 11:05:54.195221 7777 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:54.195295 7777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:54.195452 7777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:54.196487 7777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "a48c2877911b4fbba4b687a832fa2118"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "f75748293cb3617af8438230cde6fff0"
server_key_iv: "db7fd2aca8bc309b664675701c0bb274"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.196874 7777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "a48c2877911b4fbba4b687a832fa2118"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "f75748293cb3617af8438230cde6fff0"
server_key_iv: "db7fd2aca8bc309b664675701c0bb274"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.198421 7777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:54.199295 7804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.199465 7777 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:54.199570 7777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "a48c2877911b4fbba4b687a832fa2118"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "f75748293cb3617af8438230cde6fff0"
server_key_iv: "db7fd2aca8bc309b664675701c0bb274"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.199657 7777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:54.219859 7777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:54.222507 7777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:54.222687 7777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:54.223264 7777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:54.223335 7777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.223379 7777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:54.223409 7777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:54.231155 7777 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:36909
I20260811 11:05:54.231201 8042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:36909 every 8 connection(s)
I20260811 11:05:54.231622 7777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:54.231864 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 7777
I20260811 11:05:54.231992 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:54.232218 26508 external_mini_cluster.cc:1428] Setting key dd7d620316994b50d269a81ae7ccd5da
I20260811 11:05:54.233808 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.223832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:48833 (local address 127.25.227.62:43583)
0811 11:05:54.223877 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.223879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.224116 (+ 237us) server_negotiation.cc:407] Connection header received
0811 11:05:54.224687 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.224689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.224704 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.224789 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.225857 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.226388 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.227444 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.227649 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.227728 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.230512 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.230514 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.230514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.230525 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.232276 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.232773 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.232774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.232774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.232838 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.233117 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.233118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.233118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.233294 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.233348 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.233677 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.233742 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:05:54.234119 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.223831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.25.227.2:48833)
0811 11:05:54.223987 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.224026 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.224570 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.224921 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.224928 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.225390 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.225730 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.225738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.226496 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.226497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.227347 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.227349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.227738 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.227740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.227924 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.228554 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.228566 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.230397 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.232362 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.232369 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.232371 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.232687 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.232903 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.232903 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.232904 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.233039 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.233363 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.233370 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.233538 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.233654 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.233845 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":91,"threads_started":1}
I20260811 11:05:54.234680 8043 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43583
I20260811 11:05:54.234774 8043 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:54.234994 8043 heartbeater.cc:511] Master 127.25.227.62:43583 requested a full tablet report, sending...
I20260811 11:05:54.235891 7385 ts_manager.cc:194] Registered new tserver with Master: a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909)
I20260811 11:05:54.236287 7385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:48833
WARNING: no policy specified for oryx/127.25.227.3@KRBTEST.COM; defaulting to no policy
I20260811 11:05:54.243734 8060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.235788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.25.227.2:51709)
0811 11:05:54.237325 (+ 1537us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.237337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.237402 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.237555 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.237556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.237799 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.237873 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.237875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.238557 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.238558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.239497 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.239500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.239852 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.239853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.239930 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.240353 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.240359 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.240785 (+ 426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.242737 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.242738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.242739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.242907 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.243144 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.243145 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.243145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.243203 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.243502 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.243502 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.243539 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.243589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.243666 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1509,"thread_start_us":77,"threads_started":1}
I20260811 11:05:54.243733 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.235833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:51709 (local address 127.25.227.62:43583)
0811 11:05:54.235872 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.235874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.237403 (+ 1529us) server_negotiation.cc:407] Connection header received
0811 11:05:54.237459 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.237459 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.237469 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.237519 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.237963 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.238447 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.239595 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.239777 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.239825 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.240897 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.240899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.240899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.240907 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.242644 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.243006 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.243008 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.243008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.243074 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.243278 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.243279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.243280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.243442 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.243500 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.243610 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.243672 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab.
Entry for principal oryx/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab.
I20260811 11:05:54.259636 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43583
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:54.342839 8065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:54.343102 8065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:54.343144 8065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:54.344302 8065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:54.344370 8065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:54.344404 8065 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 11:05:54.344445 8065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:54.346031 8065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.25.227.62:43583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:54.346318 8065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:54.346552 8065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:54.351715 8086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:54.351900 8065 server_base.cc:1034] running on GCE node
W20260811 11:05:54.351711 8081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:54.351707 8082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:54.352177 8065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:54.352403 8065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:54.353546 8065 hybrid_clock.cc:648] HybridClock initialized: now 1786446354353531 us; error 30 us; skew 500 ppm
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:54.356168 8065 init.cc:377] Logged in from keytab as oryx/127.25.227.3@KRBTEST.COM (short username oryx)
I20260811 11:05:54.356650 8065 webserver.cc:460] Webserver started at http://127.25.227.3:34471/ using document root <none> and password file <none>
I20260811 11:05:54.356879 8065 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:54.356925 8065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:54.357075 8065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:54.358206 8065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "aee4b572265daa05bbd7e9023597432b"
server_key_iv: "b63772eb1f1fcc370960cc4d9a14ad94"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.358573 8065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "aee4b572265daa05bbd7e9023597432b"
server_key_iv: "b63772eb1f1fcc370960cc4d9a14ad94"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.359941 8065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:05:54.360707 8099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.360908 8065 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:54.361007 8065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
format_stamp: "Formatted at 2026-08-11 11:05:54 on dist-test-slave-z8x9"
server_key: "aee4b572265daa05bbd7e9023597432b"
server_key_iv: "b63772eb1f1fcc370960cc4d9a14ad94"
server_key_version: "encryptionkey@0"
I20260811 11:05:54.361057 8065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:54.382376 8065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:54.384367 8065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:54.384485 8065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:54.385074 8065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:54.385115 8065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.385140 8065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:54.385179 8065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:54.392586 8065 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:34965
I20260811 11:05:54.392659 8326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:34965 every 8 connection(s)
I20260811 11:05:54.393014 8065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:54.395210 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 8065
I20260811 11:05:54.395372 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:54.395617 26508 external_mini_cluster.cc:1428] Setting key 84ce9f580c77802f91fdc3281fbd6901
I20260811 11:05:54.395934 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.385491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:34029 (local address 127.25.227.62:43583)
0811 11:05:54.385564 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.385566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.385767 (+ 201us) server_negotiation.cc:407] Connection header received
0811 11:05:54.386352 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.386354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.386369 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.386455 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.387158 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.387963 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.389741 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.390087 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.390166 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.393029 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.393030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.393031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.393038 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.394527 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.394907 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.394908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.394908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.394964 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.395185 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.395187 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.395187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.395371 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.395448 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.395734 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.395830 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:05:54.396111 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.385477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.25.227.3:34029)
0811 11:05:54.385630 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.385670 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.386205 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.386548 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.386552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.386867 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.387058 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.387062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.388103 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.388104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.389645 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.389649 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.390208 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.390209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.390387 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.390896 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.390908 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.392940 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.394600 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.394606 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.394608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.394835 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.395018 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.395018 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.395018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.395112 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.395448 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.395454 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.395592 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.395707 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.395871 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260811 11:05:54.396628 8328 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43583
I20260811 11:05:54.396735 8328 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:54.396994 8328 heartbeater.cc:511] Master 127.25.227.62:43583 requested a full tablet report, sending...
I20260811 11:05:54.397449 7386 ts_manager.cc:194] Registered new tserver with Master: ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:54.398003 7386 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:34029
I20260811 11:05:54.403236 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.398045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:48673 (local address 127.25.227.62:43583)
0811 11:05:54.398082 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.398083 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.398092 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:54.398197 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.398198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.398210 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.398266 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.398659 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.399111 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.399776 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.399949 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.399997 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.400791 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.400792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.400792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.400798 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.402246 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.402572 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.402573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.402574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.402627 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.402782 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.402783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.402783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.402870 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.402913 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.403112 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.403177 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 11:05:54.403285 8335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.397886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.25.227.3:48673)
0811 11:05:54.398036 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.398049 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.398102 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.398269 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.398270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.398506 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.398576 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.398578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.399199 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.399200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.399694 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.399696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.400013 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.400013 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.400060 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.400436 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.400440 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.400708 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.402343 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.402344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.402344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.402508 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.402687 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.402687 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.402688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.402743 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.402929 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.402930 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.402983 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.403086 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.403197 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260811 11:05:54.407611 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:05:54.430193 7476 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:54.424779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41514 (local address 127.25.227.62:43583)
0811 11:05:54.424842 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.424844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.424853 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:54.424897 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.424898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.424908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.424959 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.425614 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.426114 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.426820 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.426995 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.427045 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.430097 (+ 3052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41514: BlockingRecv error: recv got EOF from 127.0.0.1:41514 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446354, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:54.437476 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.431007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41520 (local address 127.25.227.62:43583)
0811 11:05:54.431058 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.431060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.431133 (+ 73us) server_negotiation.cc:407] Connection header received
0811 11:05:54.431187 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.431187 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.431196 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.431251 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.431675 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.432120 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.432734 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.432905 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.432953 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.435071 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.435072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.435072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.435078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.436480 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.436777 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.436778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.436778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.436831 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.436996 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.436996 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.436997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.437094 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.437224 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.437329 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.437387 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 11:05:54.439062 7386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:54.440642 7386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:54.447324 8371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.443085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:36909 (local address 127.0.0.1:50682)
0811 11:05:54.443336 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.443348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.443399 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.443640 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.443643 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.443645 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.443712 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.443715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.445040 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.445041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.446230 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.446233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.447006 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.447007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.447098 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.447112 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.447187 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.447238 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":53,"thread_start_us":102,"threads_started":1}
I20260811 11:05:54.447343 8374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.443222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50682 (local address 127.25.227.2:36909)
0811 11:05:54.443460 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.443464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.443481 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:05:54.443513 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.443515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.443527 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.443623 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.443826 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.444935 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.446322 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.446934 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.447007 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.447089 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.447203 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.447239 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
I20260811 11:05:54.447719 8372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.443039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.0.0.1:55612)
0811 11:05:54.443246 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.443290 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.443358 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.443991 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.443992 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.443994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.444040 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.444042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.444998 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.444999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.446446 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.446448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.447465 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.447466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.447535 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.447538 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.447590 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.447637 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":55,"thread_start_us":62,"threads_started":1}
I20260811 11:05:54.447819 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.443501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33608 (local address 127.25.227.3:34965)
0811 11:05:54.443694 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.443698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.443708 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:54.443758 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.443760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.443780 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.443926 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.444149 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.445153 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.446534 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.447285 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.447352 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.447424 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.447682 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.447717 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":91,"threads_started":1}
I20260811 11:05:54.447968 8375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.443304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34965 (local address 127.0.0.1:33608)
0811 11:05:54.443525 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.443535 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.443582 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.443993 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.443994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.443997 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.444046 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.444048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.445240 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.445241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.446425 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.446428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.447464 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.447465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.447536 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.447540 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.447590 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.447638 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":5,"thread_start_us":71,"threads_started":1}
I20260811 11:05:54.448076 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.443152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55612 (local address 127.25.227.1:46407)
0811 11:05:54.443775 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.443780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.443790 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:54.443830 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.443832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.443847 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.443923 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.444132 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.444910 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.446534 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.447279 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.447352 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.447423 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.447907 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.447951 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":89,"threads_started":1}
I20260811 11:05:54.448172 7904 tablet_service.cc:1467] Processing CreateTablet for tablet b17bf2684eee4b67a1c697e2d79f49c7 (DEFAULT_TABLE table=test-table [id=16e9136bd5f243bfa9c33a060bae2528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:54.448604 7904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17bf2684eee4b67a1c697e2d79f49c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.448601 8209 tablet_service.cc:1467] Processing CreateTablet for tablet b17bf2684eee4b67a1c697e2d79f49c7 (DEFAULT_TABLE table=test-table [id=16e9136bd5f243bfa9c33a060bae2528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:54.448958 8209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17bf2684eee4b67a1c697e2d79f49c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.449765 7643 tablet_service.cc:1467] Processing CreateTablet for tablet b17bf2684eee4b67a1c697e2d79f49c7 (DEFAULT_TABLE table=test-table [id=16e9136bd5f243bfa9c33a060bae2528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:54.450119 7643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b17bf2684eee4b67a1c697e2d79f49c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.452212 8380 tablet_bootstrap.cc:492] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Bootstrap starting.
I20260811 11:05:54.452800 8386 tablet_bootstrap.cc:492] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Bootstrap starting.
I20260811 11:05:54.452992 8380 tablet_bootstrap.cc:654] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.453419 8380 log.cc:824] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:54.453508 8386 tablet_bootstrap.cc:654] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.453825 8386 log.cc:824] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:54.454276 8380 tablet_bootstrap.cc:492] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: No bootstrap required, opened a new log
I20260811 11:05:54.454265 8392 tablet_bootstrap.cc:492] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Bootstrap starting.
I20260811 11:05:54.454358 8380 ts_tablet_manager.cc:1397] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 11:05:54.454972 8386 tablet_bootstrap.cc:492] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: No bootstrap required, opened a new log
I20260811 11:05:54.455060 8386 ts_tablet_manager.cc:1397] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 11:05:54.455945 8380 raft_consensus.cc:348] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.456090 8380 raft_consensus.cc:374] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.456111 8380 raft_consensus.cc:729] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac6ae78fa0e94b77ba8429131f6ddb66, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.456236 8380 consensus_queue.cc:260] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.456549 8380 ts_tablet_manager.cc:1428] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 11:05:54.456697 8386 raft_consensus.cc:348] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.456844 8386 raft_consensus.cc:374] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.456889 8386 raft_consensus.cc:729] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.457008 8386 consensus_queue.cc:260] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.457266 8328 heartbeater.cc:503] Master 127.25.227.62:43583 was elected leader, sending a full tablet report...
I20260811 11:05:54.457321 8386 ts_tablet_manager.cc:1428] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 11:05:54.457361 8043 heartbeater.cc:503] Master 127.25.227.62:43583 was elected leader, sending a full tablet report...
I20260811 11:05:54.457863 8392 tablet_bootstrap.cc:654] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.458285 8392 log.cc:824] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:54.459102 8392 tablet_bootstrap.cc:492] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: No bootstrap required, opened a new log
I20260811 11:05:54.459158 8392 ts_tablet_manager.cc:1397] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 11:05:54.460594 8392 raft_consensus.cc:348] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.460795 8392 raft_consensus.cc:374] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.460837 8392 raft_consensus.cc:729] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.460953 8392 consensus_queue.cc:260] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.461278 8392 ts_tablet_manager.cc:1428] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:05:54.461334 7766 heartbeater.cc:503] Master 127.25.227.62:43583 was elected leader, sending a full tablet report...
W20260811 11:05:54.482389 8047 tablet.cc:2369] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:54.503266 8397 raft_consensus.cc:482] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:54.503413 8397 raft_consensus.cc:504] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.503784 8397 leader_election.cc:288] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:54.506815 7563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.503977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:36909 (local address 127.25.227.1:55533)
0811 11:05:54.504057 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.504084 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.504141 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.504290 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.504291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.504293 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.504375 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.504377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.505043 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.505045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.505875 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.505878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.506516 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.506517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.506612 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.506616 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.506691 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.506736 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 11:05:54.506815 8374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.504045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:55533 (local address 127.25.227.2:36909)
0811 11:05:54.504108 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.504110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.504123 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:05:54.504225 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.504227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.504236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.504284 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.504475 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.504955 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.505975 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.506348 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.506447 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.506458 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.506697 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.506739 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:05:54.507150 8401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.504104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34965 (local address 127.25.227.1:42051)
0811 11:05:54.504358 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.504367 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.504442 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.504600 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.504601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.504602 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.504689 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.504690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.505388 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.505390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.506110 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.506113 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.506813 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.506814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.506891 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.506896 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.506989 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.507034 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":166,"threads_started":1}
I20260811 11:05:54.507155 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.504194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:42051 (local address 127.25.227.3:34965)
0811 11:05:54.504274 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.504276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.504433 (+ 157us) server_negotiation.cc:407] Connection header received
0811 11:05:54.504519 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.504521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.504532 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.504586 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.504765 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.505295 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.506207 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.506716 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.506813 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.506822 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.507004 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.507049 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:05:54.507304 7951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bf2684eee4b67a1c697e2d79f49c7" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48c2877911b4fbba4b687a832fa2118" is_pre_election: true
I20260811 11:05:54.507465 7951 raft_consensus.cc:2454] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 0.
I20260811 11:05:54.507737 7555 leader_election.cc:302] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccd15ea8b5d42c98221248ec06dc556, a48c2877911b4fbba4b687a832fa2118; no voters:
I20260811 11:05:54.507870 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bf2684eee4b67a1c697e2d79f49c7" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" is_pre_election: true
I20260811 11:05:54.508035 8242 raft_consensus.cc:2454] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 0.
I20260811 11:05:54.508154 8397 raft_consensus.cc:2781] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:54.508229 8397 raft_consensus.cc:482] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:54.508251 8397 raft_consensus.cc:3037] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.509222 8397 raft_consensus.cc:504] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.509372 8397 leader_election.cc:288] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 election: Requested vote from peers a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:54.509536 7951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bf2684eee4b67a1c697e2d79f49c7" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48c2877911b4fbba4b687a832fa2118"
I20260811 11:05:54.509582 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b17bf2684eee4b67a1c697e2d79f49c7" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
I20260811 11:05:54.509641 7951 raft_consensus.cc:3037] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.509671 8242 raft_consensus.cc:3037] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.510360 7951 raft_consensus.cc:2454] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 1.
I20260811 11:05:54.510411 8242 raft_consensus.cc:2454] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 1.
I20260811 11:05:54.510583 7555 leader_election.cc:302] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccd15ea8b5d42c98221248ec06dc556, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:54.510694 8397 raft_consensus.cc:2781] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:54.510900 8397 raft_consensus.cc:686] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 LEADER]: Becoming Leader. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Running, Role: LEADER
I20260811 11:05:54.511035 8397 consensus_queue.cc:237] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.511922 7385 catalog_manager.cc:5495] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1). New cstate: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:54.519368 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.517008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55626 (local address 127.25.227.1:46407)
0811 11:05:54.517048 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.517051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.517059 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:05:54.517148 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.517149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.517215 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.517317 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:54.517447 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.517890 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.518638 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.518826 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.518901 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.519070 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.519159 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.519249 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.519276 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.519294 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:05:54.520990 7951 raft_consensus.cc:1261] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Refusing update from remote peer 3ccd15ea8b5d42c98221248ec06dc556: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:54.520990 8242 raft_consensus.cc:1261] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Refusing update from remote peer 3ccd15ea8b5d42c98221248ec06dc556: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:54.521404 8402 consensus_queue.cc:1035] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:54.521540 8397 consensus_queue.cc:1035] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:54.523839 8409 mvcc.cc:205] Tried to move back new op lower bound from 7317284268115464192 to 7317284268077867008. Current Snapshot: MvccSnapshot[applied={T|T < 7317284268115464192}]
I20260811 11:05:54.524073 8411 mvcc.cc:205] Tried to move back new op lower bound from 7317284268115464192 to 7317284268077867008. Current Snapshot: MvccSnapshot[applied={T|T < 7317284268115464192}]
I20260811 11:05:54.526237 7386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:54.526346 7386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:54.527092 7386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Sending DeleteTablet for 3 replicas of tablet b17bf2684eee4b67a1c697e2d79f49c7
I20260811 11:05:54.527408 7904 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bf2684eee4b67a1c697e2d79f49c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:54 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:50682
I20260811 11:05:54.527443 7643 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bf2684eee4b67a1c697e2d79f49c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:54 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:55612
I20260811 11:05:54.527463 8209 tablet_service.cc:1514] Processing DeleteTablet for tablet b17bf2684eee4b67a1c697e2d79f49c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:54 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33608
I20260811 11:05:54.527678 8430 tablet_replica.cc:330] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: stopping tablet replica
I20260811 11:05:54.527783 8430 raft_consensus.cc:2229] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:54.527878 8430 raft_consensus.cc:2258] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:54.527931 7386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 11:05:54.528071 8429 tablet_replica.cc:330] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: stopping tablet replica
W20260811 11:05:54.528088 7386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:54.528107 8432 tablet_replica.cc:330] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: stopping tablet replica
I20260811 11:05:54.528162 8429 raft_consensus.cc:2229] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:54.528198 8432 raft_consensus.cc:2229] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:54.528280 8429 raft_consensus.cc:2258] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:54.528312 8432 raft_consensus.cc:2258] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:54.528749 8429 ts_tablet_manager.cc:1905] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:54.528756 8432 ts_tablet_manager.cc:1905] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:54.529687 7643 tablet_service.cc:1467] Processing CreateTablet for tablet 51a70dabf98f47ed9d1bee834e767402 (DEFAULT_TABLE table=test-table [id=64e3af2b700348b28baec44598df7a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:54.529815 7643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a70dabf98f47ed9d1bee834e767402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.529816 7904 tablet_service.cc:1467] Processing CreateTablet for tablet 51a70dabf98f47ed9d1bee834e767402 (DEFAULT_TABLE table=test-table [id=64e3af2b700348b28baec44598df7a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:54.529922 7904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a70dabf98f47ed9d1bee834e767402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.530896 8432 ts_tablet_manager.cc:1918] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:54.530965 8432 log.cc:1196] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/b17bf2684eee4b67a1c697e2d79f49c7
I20260811 11:05:54.531180 8386 tablet_bootstrap.cc:492] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Bootstrap starting.
I20260811 11:05:54.531196 8392 tablet_bootstrap.cc:492] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Bootstrap starting.
I20260811 11:05:54.531229 8432 ts_tablet_manager.cc:1939] T b17bf2684eee4b67a1c697e2d79f49c7 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting consensus metadata
I20260811 11:05:54.531654 8392 tablet_bootstrap.cc:654] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.531684 8386 tablet_bootstrap.cc:654] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.532209 8209 tablet_service.cc:1467] Processing CreateTablet for tablet 51a70dabf98f47ed9d1bee834e767402 (DEFAULT_TABLE table=test-table [id=64e3af2b700348b28baec44598df7a93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:54.532326 8209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a70dabf98f47ed9d1bee834e767402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.532498 8392 tablet_bootstrap.cc:492] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: No bootstrap required, opened a new log
I20260811 11:05:54.532542 8392 ts_tablet_manager.cc:1397] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:54.532683 8392 raft_consensus.cc:348] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.532744 8392 raft_consensus.cc:374] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.532765 8392 raft_consensus.cc:729] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.532823 8392 consensus_queue.cc:260] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.532919 8392 ts_tablet_manager.cc:1428] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.533147 8429 ts_tablet_manager.cc:1918] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:54.533241 8429 log.cc:1196] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/b17bf2684eee4b67a1c697e2d79f49c7
I20260811 11:05:54.533514 8429 ts_tablet_manager.cc:1939] T b17bf2684eee4b67a1c697e2d79f49c7 P a48c2877911b4fbba4b687a832fa2118: Deleting consensus metadata
I20260811 11:05:54.533617 8380 tablet_bootstrap.cc:492] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Bootstrap starting.
I20260811 11:05:54.533876 7366 catalog_manager.cc:4841] TS ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965): tablet b17bf2684eee4b67a1c697e2d79f49c7 (table test-table [id=16e9136bd5f243bfa9c33a060bae2528]) successfully deleted
I20260811 11:05:54.534047 8380 tablet_bootstrap.cc:654] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.534114 7366 catalog_manager.cc:4841] TS a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909): tablet b17bf2684eee4b67a1c697e2d79f49c7 (table test-table [id=16e9136bd5f243bfa9c33a060bae2528]) successfully deleted
I20260811 11:05:54.534780 8386 tablet_bootstrap.cc:492] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: No bootstrap required, opened a new log
I20260811 11:05:54.534834 8386 ts_tablet_manager.cc:1397] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 11:05:54.534978 8386 raft_consensus.cc:348] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.535046 8386 raft_consensus.cc:374] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.535060 8386 raft_consensus.cc:729] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.535118 8386 consensus_queue.cc:260] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.535208 8386 ts_tablet_manager.cc:1428] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.535522 8430 ts_tablet_manager.cc:1905] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:54.536875 8430 ts_tablet_manager.cc:1918] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:54.536937 8430 log.cc:1196] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/b17bf2684eee4b67a1c697e2d79f49c7
I20260811 11:05:54.537261 8430 ts_tablet_manager.cc:1939] T b17bf2684eee4b67a1c697e2d79f49c7 P 3ccd15ea8b5d42c98221248ec06dc556: Deleting consensus metadata
I20260811 11:05:54.537665 7363 catalog_manager.cc:4841] TS 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407): tablet b17bf2684eee4b67a1c697e2d79f49c7 (table test-table [id=16e9136bd5f243bfa9c33a060bae2528]) successfully deleted
I20260811 11:05:54.537920 8380 tablet_bootstrap.cc:492] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: No bootstrap required, opened a new log
I20260811 11:05:54.537981 8380 ts_tablet_manager.cc:1397] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 11:05:54.538146 8380 raft_consensus.cc:348] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.538205 8380 raft_consensus.cc:374] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.538219 8380 raft_consensus.cc:729] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac6ae78fa0e94b77ba8429131f6ddb66, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.538280 8380 consensus_queue.cc:260] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.538378 8380 ts_tablet_manager.cc:1428] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260811 11:05:54.568054 7767 tablet.cc:2369] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:05:54.643965 8330 tablet.cc:2369] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:05:54.785012 8394 raft_consensus.cc:482] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:54.785130 8394 raft_consensus.cc:504] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.785544 8394 leader_election.cc:288] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407), a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909)
I20260811 11:05:54.789616 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.785861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:37129 (local address 127.25.227.1:46407)
0811 11:05:54.785909 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.785911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.785941 (+ 30us) server_negotiation.cc:407] Connection header received
0811 11:05:54.786013 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.786014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.786025 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.786082 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.786275 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.787040 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.788639 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.789219 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.789303 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.789311 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.789489 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.789535 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:05:54.789613 8374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.785845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:54507 (local address 127.25.227.2:36909)
0811 11:05:54.785898 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.785900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.785954 (+ 54us) server_negotiation.cc:407] Connection header received
0811 11:05:54.785988 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.785990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.786001 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.786063 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:54.786290 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.787034 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.788639 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.789216 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.789301 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.789311 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.789489 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.789536 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 11:05:54.789630 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.785755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:36909 (local address 127.25.227.3:54507)
0811 11:05:54.785832 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.785845 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.785896 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.786095 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.786096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.786098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.786186 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.786188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.787131 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.787132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.788532 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.788535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.789311 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.789312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.789396 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.789403 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.789467 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.789517 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":89}
I20260811 11:05:54.789638 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.785770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.25.227.3:37129)
0811 11:05:54.785884 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.785893 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.785944 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.786095 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.786096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.786098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:54.786186 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.786188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.787131 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.787132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.788532 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.788535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.789331 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.789332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.789396 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.789403 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.789467 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.789517 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":89,"thread_start_us":64,"threads_started":1}
I20260811 11:05:54.789932 7951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a70dabf98f47ed9d1bee834e767402" candidate_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48c2877911b4fbba4b687a832fa2118" is_pre_election: true
I20260811 11:05:54.790062 7951 raft_consensus.cc:2454] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac6ae78fa0e94b77ba8429131f6ddb66 in term 0.
I20260811 11:05:54.790058 7682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a70dabf98f47ed9d1bee834e767402" candidate_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ccd15ea8b5d42c98221248ec06dc556" is_pre_election: true
I20260811 11:05:54.790208 7682 raft_consensus.cc:2454] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac6ae78fa0e94b77ba8429131f6ddb66 in term 0.
I20260811 11:05:54.790251 8109 leader_election.cc:302] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a48c2877911b4fbba4b687a832fa2118, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:54.790409 8394 raft_consensus.cc:2781] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:54.790462 8394 raft_consensus.cc:482] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:54.790493 8394 raft_consensus.cc:3037] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.791205 8394 raft_consensus.cc:504] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.791374 8394 leader_election.cc:288] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [CANDIDATE]: Term 1 election: Requested vote from peers 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407), a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909)
I20260811 11:05:54.791554 7682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a70dabf98f47ed9d1bee834e767402" candidate_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ccd15ea8b5d42c98221248ec06dc556"
I20260811 11:05:54.791553 7951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a70dabf98f47ed9d1bee834e767402" candidate_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48c2877911b4fbba4b687a832fa2118"
I20260811 11:05:54.791633 7951 raft_consensus.cc:3037] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.791633 7682 raft_consensus.cc:3037] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.792433 7951 raft_consensus.cc:2454] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac6ae78fa0e94b77ba8429131f6ddb66 in term 1.
I20260811 11:05:54.792637 8109 leader_election.cc:302] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a48c2877911b4fbba4b687a832fa2118, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:54.792690 7682 raft_consensus.cc:2454] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac6ae78fa0e94b77ba8429131f6ddb66 in term 1.
I20260811 11:05:54.792776 8394 raft_consensus.cc:2781] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:54.792974 8394 raft_consensus.cc:686] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 LEADER]: Becoming Leader. State: Replica: ac6ae78fa0e94b77ba8429131f6ddb66, State: Running, Role: LEADER
I20260811 11:05:54.793066 8394 consensus_queue.cc:237] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.793887 7386 catalog_manager.cc:5495] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3). New cstate: current_term: 1 leader_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } health_report { overall_health: HEALTHY } } }
Aug 11 11:05:54 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446353, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.62@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:54.853070 8455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.846021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43583 (local address 127.0.0.1:41532)
0811 11:05:54.846217 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.846237 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.846315 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.846465 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.846465 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.846806 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:54.846876 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.846878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.847549 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.847550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.848077 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.848078 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.848388 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.848389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.848431 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.849021 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:54.849026 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:54.850475 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:54.851868 (+ 1393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.851875 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.851877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.852074 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.852246 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:54.852247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:54.852247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:54.852538 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:54.852762 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:54.852769 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:54.852813 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.852869 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.852966 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":129,"threads_started":1}
I20260811 11:05:54.853125 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.846061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41532 (local address 127.25.227.62:43583)
0811 11:05:54.846124 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.846126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.846320 (+ 194us) server_negotiation.cc:407] Connection header received
0811 11:05:54.846359 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.846361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.846373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.846451 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:54.846947 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.847471 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.848147 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.848322 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.848371 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.850599 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:54.850601 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:54.850601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:54.850607 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:54.851798 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.852137 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.852138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.852138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.852189 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:54.852606 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:54.852607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:54.852607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:54.852702 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:54.852750 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.852899 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.853024 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":37}
I20260811 11:05:54.855304 7386 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:41532:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 11:05:54.855526 7386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:54.857105 7643 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac5035c42da4b419e898d44da3467cf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c9a576738afe49f2858de3f8e7f7ba0e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:54.857213 8209 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac5035c42da4b419e898d44da3467cf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c9a576738afe49f2858de3f8e7f7ba0e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:54.857223 7904 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac5035c42da4b419e898d44da3467cf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c9a576738afe49f2858de3f8e7f7ba0e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 11:05:54.857333 7643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac5035c42da4b419e898d44da3467cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.857370 8209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac5035c42da4b419e898d44da3467cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.857458 7904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac5035c42da4b419e898d44da3467cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:54.858759 8386 tablet_bootstrap.cc:492] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: Bootstrap starting.
I20260811 11:05:54.858994 8380 tablet_bootstrap.cc:492] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: Bootstrap starting.
I20260811 11:05:54.859495 8386 tablet_bootstrap.cc:654] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.859542 8380 tablet_bootstrap.cc:654] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.859869 8392 tablet_bootstrap.cc:492] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: Bootstrap starting.
I20260811 11:05:54.860334 8392 tablet_bootstrap.cc:654] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:54.860661 8380 tablet_bootstrap.cc:492] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: No bootstrap required, opened a new log
I20260811 11:05:54.860716 8380 ts_tablet_manager.cc:1397] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 11:05:54.860800 8386 tablet_bootstrap.cc:492] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: No bootstrap required, opened a new log
I20260811 11:05:54.860864 8386 ts_tablet_manager.cc:1397] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 11:05:54.860889 8380 raft_consensus.cc:348] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.860980 8380 raft_consensus.cc:374] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.861009 8380 raft_consensus.cc:729] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac6ae78fa0e94b77ba8429131f6ddb66, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.861057 8380 consensus_queue.cc:260] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.861090 8386 raft_consensus.cc:348] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.861197 8386 raft_consensus.cc:374] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.861195 8380 ts_tablet_manager.cc:1428] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 11:05:54.861234 8386 raft_consensus.cc:729] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.861286 8386 consensus_queue.cc:260] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.861330 8394 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.861394 8386 ts_tablet_manager.cc:1428] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.861406 8394 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.861440 8395 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.861541 8395 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.861624 8392 tablet_bootstrap.cc:492] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: No bootstrap required, opened a new log
I20260811 11:05:54.861676 8392 ts_tablet_manager.cc:1397] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:54.861783 8392 raft_consensus.cc:348] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.861843 8392 raft_consensus.cc:374] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:54.861856 8392 raft_consensus.cc:729] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Initialized, Role: FOLLOWER
I20260811 11:05:54.861932 8392 consensus_queue.cc:260] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.862025 8392 ts_tablet_manager.cc:1428] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:54.862062 8421 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.862152 8421 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.946460 8421 raft_consensus.cc:482] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:54.946583 8421 raft_consensus.cc:504] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.946781 8421 leader_election.cc:288] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:54.947068 7951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac5035c42da4b419e898d44da3467cf" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48c2877911b4fbba4b687a832fa2118" is_pre_election: true
I20260811 11:05:54.947197 7951 raft_consensus.cc:2454] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 0.
I20260811 11:05:54.947094 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac5035c42da4b419e898d44da3467cf" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" is_pre_election: true
I20260811 11:05:54.947254 8242 raft_consensus.cc:2454] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 0.
I20260811 11:05:54.947386 7555 leader_election.cc:302] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccd15ea8b5d42c98221248ec06dc556, a48c2877911b4fbba4b687a832fa2118; no voters:
I20260811 11:05:54.947505 8421 raft_consensus.cc:2781] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:54.947556 8421 raft_consensus.cc:482] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:54.947582 8421 raft_consensus.cc:3037] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.948417 8421 raft_consensus.cc:504] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.948560 8421 leader_election.cc:288] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 election: Requested vote from peers a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:54.948752 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac5035c42da4b419e898d44da3467cf" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
I20260811 11:05:54.948752 7951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac5035c42da4b419e898d44da3467cf" candidate_uuid: "3ccd15ea8b5d42c98221248ec06dc556" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48c2877911b4fbba4b687a832fa2118"
I20260811 11:05:54.948839 7951 raft_consensus.cc:3037] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.948839 8242 raft_consensus.cc:3037] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:54.949647 8242 raft_consensus.cc:2454] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 1.
I20260811 11:05:54.949647 7951 raft_consensus.cc:2454] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ccd15ea8b5d42c98221248ec06dc556 in term 1.
I20260811 11:05:54.949872 7555 leader_election.cc:302] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccd15ea8b5d42c98221248ec06dc556, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:54.949970 8421 raft_consensus.cc:2781] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:54.950026 8421 raft_consensus.cc:686] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 LEADER]: Becoming Leader. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Running, Role: LEADER
I20260811 11:05:54.950080 8421 consensus_queue.cc:237] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:54.950342 8402 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: TxnStatusTablet state changed. Reason: New leader 3ccd15ea8b5d42c98221248ec06dc556. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.950425 8402 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:54.950564 8463 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 11:05:54.950704 8463 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 11:05:54.950691 7386 catalog_manager.cc:5495] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1). New cstate: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:54.956380 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.953854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.25.227.1:46407)
0811 11:05:54.953920 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.953922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.953932 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:54.954019 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.954019 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.954028 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.954073 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:54.954198 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.954657 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.955725 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.955899 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.955950 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.956150 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.956179 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.956216 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.956310 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.956328 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:05:54.956450 8455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.953764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.0.0.1:55634)
0811 11:05:54.953875 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.953889 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.953944 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.954081 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.954082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.954083 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:54.954138 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.954141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.954733 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.954735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.955634 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.955637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.955975 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.955976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.956050 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.956070 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.956240 (+ 170us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.956252 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.956309 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.956371 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 11:05:54.957386 7951 raft_consensus.cc:1261] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Refusing update from remote peer 3ccd15ea8b5d42c98221248ec06dc556: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:54.957404 8242 raft_consensus.cc:1261] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Refusing update from remote peer 3ccd15ea8b5d42c98221248ec06dc556: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:54.957616 8421 consensus_queue.cc:1035] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:54.957733 8421 consensus_queue.cc:1035] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:54.958230 8395 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: TxnStatusTablet state changed. Reason: New leader 3ccd15ea8b5d42c98221248ec06dc556. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.958355 8395 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.958367 8394 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: TxnStatusTablet state changed. Reason: New leader 3ccd15ea8b5d42c98221248ec06dc556. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.958456 8394 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.959121 8421 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.959206 8421 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:54.959439 8395 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.959525 8395 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P a48c2877911b4fbba4b687a832fa2118: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.959673 8421 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.959739 8421 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P 3ccd15ea8b5d42c98221248ec06dc556: This TxnStatusTablet replica's current role is: LEADER
I20260811 11:05:54.960613 8412 mvcc.cc:205] Tried to move back new op lower bound from 7317284269903564800 to 7317284269875740672. Current Snapshot: MvccSnapshot[applied={T|T < 7317284269903564800}]
I20260811 11:05:54.960723 8394 tablet_replica.cc:439] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3ccd15ea8b5d42c98221248ec06dc556" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } } }
I20260811 11:05:54.960800 8394 tablet_replica.cc:442] T 9ac5035c42da4b419e898d44da3467cf P ac6ae78fa0e94b77ba8429131f6ddb66: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 11:05:54.964046 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.961625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33620 (local address 127.25.227.3:34965)
0811 11:05:54.961665 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.961666 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.961675 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:05:54.961744 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.961744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.961771 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.961860 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:54.961962 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.962427 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.963161 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.963433 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.963512 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.963689 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.963808 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.963885 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.963931 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.963951 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:05:54.969468 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.966788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:53601 (local address 127.25.227.1:46407)
0811 11:05:54.966912 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.966914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.966994 (+ 80us) server_negotiation.cc:407] Connection header received
0811 11:05:54.967068 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.967069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.967079 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.967124 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:54.967263 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.967690 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.968781 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.968958 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.969011 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.969231 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.969275 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.969315 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.969397 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.969415 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 11:05:54.969619 8473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.966687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.25.227.3:53601)
0811 11:05:54.966935 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.966947 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.967010 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.967127 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.967127 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.967129 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:54.967198 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.967199 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.967770 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.967771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.968677 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.968680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.969032 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.969033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.969104 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.969120 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.969337 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.969339 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.969395 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.969441 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":171,"threads_started":1}
I20260811 11:05:54.972229 7951 raft_consensus.cc:1261] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Refusing update from remote peer ac6ae78fa0e94b77ba8429131f6ddb66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:54.972321 7682 raft_consensus.cc:1261] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Refusing update from remote peer ac6ae78fa0e94b77ba8429131f6ddb66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:54.972509 8442 consensus_queue.cc:1035] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:54.972622 8394 consensus_queue.cc:1035] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:54.981542 8480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.978507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34965 (local address 127.25.227.1:40365)
0811 11:05:54.978670 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:54.978680 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:54.978734 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:54.978857 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:54.978858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:54.978859 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:54.978898 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.978900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.979735 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.979736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.980643 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:54.980646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.981107 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.981108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:54.981147 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.981162 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.981408 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.981410 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:05:54.981445 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 11:05:54.981483 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260811 11:05:54.981577 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:54.978540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:40365 (local address 127.25.227.3:34965)
0811 11:05:54.978576 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:54.978578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:54.978755 (+ 177us) server_negotiation.cc:407] Connection header received
0811 11:05:54.978782 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:54.978783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:54.978794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:54.978857 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:54.978935 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.979648 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.980719 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:54.981029 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:54.981103 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:54.981309 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:54.981344 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:54.981401 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:54.981450 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 11:05:54.981474 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 11:05:54.991154 7386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:54.991269 7386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:54.991930 7386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Sending DeleteTablet for 3 replicas of tablet 51a70dabf98f47ed9d1bee834e767402
I20260811 11:05:54.992177 7643 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a70dabf98f47ed9d1bee834e767402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:54 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:55612
I20260811 11:05:54.992328 8430 tablet_replica.cc:330] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: stopping tablet replica
I20260811 11:05:54.992414 8430 raft_consensus.cc:2229] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:54.992460 8430 raft_consensus.cc:2258] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:54.992532 7904 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a70dabf98f47ed9d1bee834e767402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:54 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:50682
I20260811 11:05:54.992620 8429 tablet_replica.cc:330] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: stopping tablet replica
I20260811 11:05:54.992660 8429 raft_consensus.cc:2229] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:54.992705 8429 raft_consensus.cc:2258] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:54.992899 8430 ts_tablet_manager.cc:1905] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:54.993013 8429 ts_tablet_manager.cc:1905] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:54.994907 8429 ts_tablet_manager.cc:1918] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:54.994966 8429 log.cc:1196] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/51a70dabf98f47ed9d1bee834e767402
I20260811 11:05:54.995167 8429 ts_tablet_manager.cc:1939] T 51a70dabf98f47ed9d1bee834e767402 P a48c2877911b4fbba4b687a832fa2118: Deleting consensus metadata
I20260811 11:05:54.995512 7366 catalog_manager.cc:4841] TS a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909): tablet 51a70dabf98f47ed9d1bee834e767402 (table test-table [id=64e3af2b700348b28baec44598df7a93]) successfully deleted
I20260811 11:05:54.995795 8209 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a70dabf98f47ed9d1bee834e767402 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:54 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33608
I20260811 11:05:54.995921 8432 tablet_replica.cc:330] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: stopping tablet replica
I20260811 11:05:54.995977 8432 raft_consensus.cc:2229] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:54.996063 8432 raft_consensus.cc:2258] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:54.996578 8432 ts_tablet_manager.cc:1905] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:54.998225 8432 ts_tablet_manager.cc:1918] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:54.998278 8432 log.cc:1196] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/51a70dabf98f47ed9d1bee834e767402
I20260811 11:05:54.998490 8432 ts_tablet_manager.cc:1939] T 51a70dabf98f47ed9d1bee834e767402 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting consensus metadata
I20260811 11:05:54.998869 7366 catalog_manager.cc:4841] TS ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965): tablet 51a70dabf98f47ed9d1bee834e767402 (table test-table [id=64e3af2b700348b28baec44598df7a93]) successfully deleted
I20260811 11:05:55.001623 8430 ts_tablet_manager.cc:1918] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:55.001688 8430 log.cc:1196] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/51a70dabf98f47ed9d1bee834e767402
I20260811 11:05:55.001926 8430 ts_tablet_manager.cc:1939] T 51a70dabf98f47ed9d1bee834e767402 P 3ccd15ea8b5d42c98221248ec06dc556: Deleting consensus metadata
I20260811 11:05:55.002285 7363 catalog_manager.cc:4841] TS 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407): tablet 51a70dabf98f47ed9d1bee834e767402 (table test-table [id=64e3af2b700348b28baec44598df7a93]) successfully deleted
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[7307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:05:55.036036 7476 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:55.028082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41536 (local address 127.25.227.62:43583)
0811 11:05:55.028133 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.028135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.028306 (+ 171us) server_negotiation.cc:407] Connection header received
0811 11:05:55.028371 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.028372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.028387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.028456 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:55.029313 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.030152 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.031334 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.031651 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.031728 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.035960 (+ 4232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41536: BlockingRecv error: recv got EOF from 127.0.0.1:41536 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[7307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM
I20260811 11:05:55.046959 7476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.037160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41552 (local address 127.25.227.62:43583)
0811 11:05:55.037229 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.037231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.037504 (+ 273us) server_negotiation.cc:407] Connection header received
0811 11:05:55.037556 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.037557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.037570 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.037630 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:55.038264 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.039130 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.040197 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.040500 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.040573 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.043419 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:55.043421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:55.043421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:55.043430 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:55.045379 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:55.045870 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:55.045871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:55.045872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:55.045942 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:55.046264 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:55.046266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:55.046266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:55.046404 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:55.046510 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:55.046659 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 11:05:55.046749 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:05:55.048679 7386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:55.048867 7386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:55.050436 7643 tablet_service.cc:1467] Processing CreateTablet for tablet 067ae25c3a9941eca03523090c38539d (DEFAULT_TABLE table=test-table [id=84b06951c37b4d3ca98221396164afbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:55.050583 7643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067ae25c3a9941eca03523090c38539d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:55.050613 7904 tablet_service.cc:1467] Processing CreateTablet for tablet 067ae25c3a9941eca03523090c38539d (DEFAULT_TABLE table=test-table [id=84b06951c37b4d3ca98221396164afbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:55.050774 7904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067ae25c3a9941eca03523090c38539d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:55.052153 8392 tablet_bootstrap.cc:492] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Bootstrap starting.
I20260811 11:05:55.052198 8209 tablet_service.cc:1467] Processing CreateTablet for tablet 067ae25c3a9941eca03523090c38539d (DEFAULT_TABLE table=test-table [id=84b06951c37b4d3ca98221396164afbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:55.052331 8209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067ae25c3a9941eca03523090c38539d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:55.052580 8392 tablet_bootstrap.cc:654] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:55.053781 8380 tablet_bootstrap.cc:492] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Bootstrap starting.
I20260811 11:05:55.053812 8386 tablet_bootstrap.cc:492] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Bootstrap starting.
I20260811 11:05:55.054271 8386 tablet_bootstrap.cc:654] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:55.054297 8380 tablet_bootstrap.cc:654] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:55.055713 8392 tablet_bootstrap.cc:492] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: No bootstrap required, opened a new log
I20260811 11:05:55.055775 8392 ts_tablet_manager.cc:1397] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:05:55.055964 8392 raft_consensus.cc:348] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.056049 8392 raft_consensus.cc:374] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:55.056071 8392 raft_consensus.cc:729] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Initialized, Role: FOLLOWER
I20260811 11:05:55.056113 8392 consensus_queue.cc:260] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.056222 8392 ts_tablet_manager.cc:1428] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:55.057687 8386 tablet_bootstrap.cc:492] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: No bootstrap required, opened a new log
I20260811 11:05:55.057760 8386 ts_tablet_manager.cc:1397] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 11:05:55.057996 8386 raft_consensus.cc:348] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.058084 8386 raft_consensus.cc:374] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:55.058106 8386 raft_consensus.cc:729] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Initialized, Role: FOLLOWER
I20260811 11:05:55.058154 8386 consensus_queue.cc:260] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.058244 8386 ts_tablet_manager.cc:1428] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:55.058483 8380 tablet_bootstrap.cc:492] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: No bootstrap required, opened a new log
I20260811 11:05:55.058537 8380 ts_tablet_manager.cc:1397] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 11:05:55.058804 8380 raft_consensus.cc:348] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.058907 8380 raft_consensus.cc:374] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:55.058933 8380 raft_consensus.cc:729] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac6ae78fa0e94b77ba8429131f6ddb66, State: Initialized, Role: FOLLOWER
I20260811 11:05:55.058974 8380 consensus_queue.cc:260] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.059060 8380 ts_tablet_manager.cc:1428] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:55.169611 8395 raft_consensus.cc:482] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:55.169772 8395 raft_consensus.cc:504] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.170174 8395 leader_election.cc:288] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:55.174424 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.170485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:58975 (local address 127.25.227.1:46407)
0811 11:05:55.170535 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.170537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.170547 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:55.170646 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.170647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.170659 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.170727 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:55.170976 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.171600 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.173368 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.173927 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.174000 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.174009 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:55.174265 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 11:05:55.174322 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 11:05:55.174726 8516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.170338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.25.227.2:58975)
0811 11:05:55.170490 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:55.170509 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:55.170560 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:55.170794 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:55.170796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:55.170799 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:55.170890 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.170892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.171693 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.171695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.173230 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.173235 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.174039 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.174040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.174150 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.174157 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 11:05:55.174542 (+ 385us) client_negotiation.cc:240] Negotiation successful
0811 11:05:55.174595 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260811 11:05:55.174966 7682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067ae25c3a9941eca03523090c38539d" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ccd15ea8b5d42c98221248ec06dc556" is_pre_election: true
I20260811 11:05:55.175083 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.170351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34965 (local address 127.25.227.2:43379)
0811 11:05:55.170627 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:55.170634 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:55.170693 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:55.170818 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:55.170819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:55.170821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:05:55.170956 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.170959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.172499 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.172500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.174123 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.174126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.174783 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.174784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.174873 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.174877 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:05:55.174952 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:05:55.174992 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":3,"thread_start_us":60,"threads_started":1}
I20260811 11:05:55.175067 8376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.170433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43379 (local address 127.25.227.3:34965)
0811 11:05:55.170506 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.170508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.170691 (+ 183us) server_negotiation.cc:407] Connection header received
0811 11:05:55.170745 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.170747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.170762 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.170814 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:05:55.171709 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.172414 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.174221 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.174673 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.174739 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.174747 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:55.174964 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 11:05:55.175001 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:05:55.175096 7682 raft_consensus.cc:2454] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 0.
I20260811 11:05:55.175339 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067ae25c3a9941eca03523090c38539d" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" is_pre_election: true
I20260811 11:05:55.175348 7810 leader_election.cc:302] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccd15ea8b5d42c98221248ec06dc556, a48c2877911b4fbba4b687a832fa2118; no voters:
I20260811 11:05:55.175454 8242 raft_consensus.cc:2454] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 0.
I20260811 11:05:55.175500 8395 raft_consensus.cc:2781] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:55.175544 8395 raft_consensus.cc:482] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:55.175575 8395 raft_consensus.cc:3037] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:55.176388 8395 raft_consensus.cc:504] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.176643 8395 leader_election.cc:288] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 election: Requested vote from peers 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:55.176849 7682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067ae25c3a9941eca03523090c38539d" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ccd15ea8b5d42c98221248ec06dc556"
I20260811 11:05:55.176857 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067ae25c3a9941eca03523090c38539d" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
I20260811 11:05:55.176941 8242 raft_consensus.cc:3037] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:55.176942 7682 raft_consensus.cc:3037] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:55.177834 8242 raft_consensus.cc:2454] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 1.
I20260811 11:05:55.177976 7682 raft_consensus.cc:2454] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 1.
I20260811 11:05:55.178026 7811 leader_election.cc:302] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a48c2877911b4fbba4b687a832fa2118, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:55.178130 8395 raft_consensus.cc:2781] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:55.178331 8395 raft_consensus.cc:686] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 1 LEADER]: Becoming Leader. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Running, Role: LEADER
I20260811 11:05:55.178416 8395 consensus_queue.cc:237] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.179230 7386 catalog_manager.cc:5495] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 reported cstate change: term changed from 0 to 1, leader changed from <none> to a48c2877911b4fbba4b687a832fa2118 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "a48c2877911b4fbba4b687a832fa2118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:55.203401 8374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.200754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50686 (local address 127.25.227.2:36909)
0811 11:05:55.200816 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.200818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.200828 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:05:55.200930 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.200931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.200952 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.201043 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:55.201229 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.201774 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.202574 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.202807 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.202868 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.203034 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:55.203154 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:55.203233 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:55.203287 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 11:05:55.203306 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:05:55.204476 8242 raft_consensus.cc:1261] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Refusing update from remote peer a48c2877911b4fbba4b687a832fa2118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:55.204568 7682 raft_consensus.cc:1261] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Refusing update from remote peer a48c2877911b4fbba4b687a832fa2118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:55.204811 8395 consensus_queue.cc:1035] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:55.204967 8525 consensus_queue.cc:1035] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:55.208168 7384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:55.208276 7384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:55.209067 7384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Sending DeleteTablet for 3 replicas of tablet 067ae25c3a9941eca03523090c38539d
I20260811 11:05:55.209337 7643 tablet_service.cc:1514] Processing DeleteTablet for tablet 067ae25c3a9941eca03523090c38539d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:55612
I20260811 11:05:55.209347 7642 tablet_service.cc:1514] Processing DeleteTablet for tablet 067ae25c3a9941eca03523090c38539d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:55612
I20260811 11:05:55.209421 7904 tablet_service.cc:1514] Processing DeleteTablet for tablet 067ae25c3a9941eca03523090c38539d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:50682
I20260811 11:05:55.209506 8209 tablet_service.cc:1514] Processing DeleteTablet for tablet 067ae25c3a9941eca03523090c38539d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33608
I20260811 11:05:55.209630 8430 tablet_replica.cc:330] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: stopping tablet replica
I20260811 11:05:55.209630 8432 tablet_replica.cc:330] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: stopping tablet replica
I20260811 11:05:55.209692 8432 raft_consensus.cc:2229] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:55.209697 8430 raft_consensus.cc:2229] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:55.209745 8430 raft_consensus.cc:2258] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:55.209750 8432 raft_consensus.cc:2258] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:55.209829 8429 tablet_replica.cc:330] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: stopping tablet replica
I20260811 11:05:55.209904 8429 raft_consensus.cc:2229] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:55.209993 8429 raft_consensus.cc:2258] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:55.209959 7384 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41552:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:05:55.210114 7384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:05:55.210529 8430 ts_tablet_manager.cc:1905] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:55.210556 8432 ts_tablet_manager.cc:1905] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:55.212103 8432 ts_tablet_manager.cc:1918] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:55.212121 8430 ts_tablet_manager.cc:1918] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:55.212177 8430 log.cc:1196] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/067ae25c3a9941eca03523090c38539d
I20260811 11:05:55.212177 8432 log.cc:1196] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/067ae25c3a9941eca03523090c38539d
I20260811 11:05:55.212406 8430 ts_tablet_manager.cc:1939] T 067ae25c3a9941eca03523090c38539d P 3ccd15ea8b5d42c98221248ec06dc556: Deleting consensus metadata
I20260811 11:05:55.212409 8432 ts_tablet_manager.cc:1939] T 067ae25c3a9941eca03523090c38539d P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting consensus metadata
I20260811 11:05:55.212741 7363 catalog_manager.cc:4841] TS 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407): tablet 067ae25c3a9941eca03523090c38539d (table test-table [id=84b06951c37b4d3ca98221396164afbd]) successfully deleted
I20260811 11:05:55.212858 7366 catalog_manager.cc:4841] TS ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965): tablet 067ae25c3a9941eca03523090c38539d (table test-table [id=84b06951c37b4d3ca98221396164afbd]) successfully deleted
W20260811 11:05:55.212879 7363 catalog_manager.cc:4808] TS 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407): delete failed for tablet 067ae25c3a9941eca03523090c38539d because the tablet was not found. No further retry: Not found: Tablet not found: 067ae25c3a9941eca03523090c38539d
I20260811 11:05:55.213101 8429 ts_tablet_manager.cc:1905] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:55.213979 8209 tablet_service.cc:1467] Processing CreateTablet for tablet db5765301d244377970f082f110a6801 (DEFAULT_TABLE table=test-table [id=ddcfe6c95b8444699f8df80720c24c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:55.213984 7904 tablet_service.cc:1467] Processing CreateTablet for tablet db5765301d244377970f082f110a6801 (DEFAULT_TABLE table=test-table [id=ddcfe6c95b8444699f8df80720c24c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:55.214107 8209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5765301d244377970f082f110a6801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:55.214109 7904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5765301d244377970f082f110a6801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:55.214799 8429 ts_tablet_manager.cc:1918] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:05:55.214869 8429 log.cc:1196] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/067ae25c3a9941eca03523090c38539d
I20260811 11:05:55.215085 8429 ts_tablet_manager.cc:1939] T 067ae25c3a9941eca03523090c38539d P a48c2877911b4fbba4b687a832fa2118: Deleting consensus metadata
I20260811 11:05:55.215405 8380 tablet_bootstrap.cc:492] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Bootstrap starting.
I20260811 11:05:55.215438 8386 tablet_bootstrap.cc:492] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Bootstrap starting.
I20260811 11:05:55.215543 7366 catalog_manager.cc:4841] TS a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909): tablet 067ae25c3a9941eca03523090c38539d (table test-table [id=84b06951c37b4d3ca98221396164afbd]) successfully deleted
I20260811 11:05:55.215767 8380 tablet_bootstrap.cc:654] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:55.215823 8386 tablet_bootstrap.cc:654] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:55.216142 7642 tablet_service.cc:1467] Processing CreateTablet for tablet db5765301d244377970f082f110a6801 (DEFAULT_TABLE table=test-table [id=ddcfe6c95b8444699f8df80720c24c2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:05:55.216241 7642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5765301d244377970f082f110a6801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:55.216907 8380 tablet_bootstrap.cc:492] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: No bootstrap required, opened a new log
I20260811 11:05:55.216969 8380 ts_tablet_manager.cc:1397] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:55.217085 8380 raft_consensus.cc:348] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.217196 8380 raft_consensus.cc:374] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:55.217221 8380 raft_consensus.cc:729] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac6ae78fa0e94b77ba8429131f6ddb66, State: Initialized, Role: FOLLOWER
I20260811 11:05:55.217268 8380 consensus_queue.cc:260] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.217370 8380 ts_tablet_manager.cc:1428] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:55.217789 8392 tablet_bootstrap.cc:492] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556: Bootstrap starting.
I20260811 11:05:55.217960 8386 tablet_bootstrap.cc:492] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: No bootstrap required, opened a new log
I20260811 11:05:55.217995 8386 ts_tablet_manager.cc:1397] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 11:05:55.218158 8386 raft_consensus.cc:348] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.218223 8386 raft_consensus.cc:374] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:55.218237 8386 raft_consensus.cc:729] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Initialized, Role: FOLLOWER
I20260811 11:05:55.218267 8392 tablet_bootstrap.cc:654] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:55.218271 8386 consensus_queue.cc:260] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.218392 8386 ts_tablet_manager.cc:1428] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:55.219470 8392 tablet_bootstrap.cc:492] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556: No bootstrap required, opened a new log
I20260811 11:05:55.219522 8392 ts_tablet_manager.cc:1397] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:05:55.219658 8392 raft_consensus.cc:348] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.219764 8392 raft_consensus.cc:374] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:55.219790 8392 raft_consensus.cc:729] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ccd15ea8b5d42c98221248ec06dc556, State: Initialized, Role: FOLLOWER
I20260811 11:05:55.219861 8392 consensus_queue.cc:260] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.219970 8392 ts_tablet_manager.cc:1428] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:55.287779 8525 raft_consensus.cc:482] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:05:55.287914 8525 raft_consensus.cc:504] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.288097 8525 leader_election.cc:288] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:55.288383 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5765301d244377970f082f110a6801" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" is_pre_election: true
I20260811 11:05:55.288391 7682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5765301d244377970f082f110a6801" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ccd15ea8b5d42c98221248ec06dc556" is_pre_election: true
I20260811 11:05:55.288501 7682 raft_consensus.cc:2454] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 0.
I20260811 11:05:55.288501 8242 raft_consensus.cc:2454] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 0.
I20260811 11:05:55.288662 7811 leader_election.cc:302] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a48c2877911b4fbba4b687a832fa2118, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:55.288789 8525 raft_consensus.cc:2781] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:05:55.288843 8525 raft_consensus.cc:482] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:05:55.288863 8525 raft_consensus.cc:3037] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:55.290050 8525 raft_consensus.cc:504] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.290201 8525 leader_election.cc:288] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 election: Requested vote from peers 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407), ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965)
I20260811 11:05:55.290361 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5765301d244377970f082f110a6801" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66"
I20260811 11:05:55.290472 8242 raft_consensus.cc:3037] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:55.290434 7682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5765301d244377970f082f110a6801" candidate_uuid: "a48c2877911b4fbba4b687a832fa2118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ccd15ea8b5d42c98221248ec06dc556"
I20260811 11:05:55.290513 7682 raft_consensus.cc:3037] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:55.291109 8242 raft_consensus.cc:2454] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 1.
I20260811 11:05:55.291290 7811 leader_election.cc:302] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a48c2877911b4fbba4b687a832fa2118, ac6ae78fa0e94b77ba8429131f6ddb66; no voters:
I20260811 11:05:55.291430 7682 raft_consensus.cc:2454] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48c2877911b4fbba4b687a832fa2118 in term 1.
I20260811 11:05:55.291709 8525 raft_consensus.cc:2781] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:55.291771 8525 raft_consensus.cc:686] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 1 LEADER]: Becoming Leader. State: Replica: a48c2877911b4fbba4b687a832fa2118, State: Running, Role: LEADER
I20260811 11:05:55.291841 8525 consensus_queue.cc:237] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } }
I20260811 11:05:55.292444 7386 catalog_manager.cc:5495] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 reported cstate change: term changed from 0 to 1, leader changed from <none> to a48c2877911b4fbba4b687a832fa2118 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "a48c2877911b4fbba4b687a832fa2118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a48c2877911b4fbba4b687a832fa2118" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 36909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 } health_report { overall_health: UNKNOWN } } }
I20260811 11:05:55.319594 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.316988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:34549 (local address 127.25.227.1:46407)
0811 11:05:55.317042 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.317044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.317163 (+ 119us) server_negotiation.cc:407] Connection header received
0811 11:05:55.317272 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.317273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.317284 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.317354 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:55.317516 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.318000 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.318854 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.319063 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.319141 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.319327 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:55.319365 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:55.319427 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:55.319482 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 11:05:55.319506 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:05:55.319636 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.316888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.25.227.2:34549)
0811 11:05:55.317077 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:55.317088 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:55.317211 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:55.317357 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:55.317358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:55.317360 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:55.317440 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.317442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.318085 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.318087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.318722 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.318724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.319140 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.319141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.319217 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.319239 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:55.319428 (+ 189us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:55.319431 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:55.319479 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 11:05:55.319528 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260811 11:05:55.321906 8242 raft_consensus.cc:1261] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Refusing update from remote peer a48c2877911b4fbba4b687a832fa2118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:55.321919 7682 raft_consensus.cc:1261] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Refusing update from remote peer a48c2877911b4fbba4b687a832fa2118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:05:55.322134 8395 consensus_queue.cc:1035] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ccd15ea8b5d42c98221248ec06dc556" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 46407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:55.322371 8395 consensus_queue.cc:1035] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac6ae78fa0e94b77ba8429131f6ddb66" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:05:55.331141 8480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.328352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:36909 (local address 127.25.227.1:47697)
0811 11:05:55.328400 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:55.328413 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:55.328458 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:55.328597 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:55.328598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:55.328599 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 11:05:55.328645 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.328648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.329570 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.329571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.330129 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:55.330131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.330635 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.330637 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:55.330696 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.330703 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 11:05:55.330953 (+ 250us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 11:05:55.330956 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:05:55.331004 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 11:05:55.331060 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 11:05:55.331151 8374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.328398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:47697 (local address 127.25.227.2:36909)
0811 11:05:55.328462 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:55.328464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:55.328493 (+ 29us) server_negotiation.cc:407] Connection header received
0811 11:05:55.328520 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:55.328521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:55.328528 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:55.328591 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:05:55.328731 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.329488 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.330213 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:55.330515 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:55.330584 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:55.330820 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:05:55.330855 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:05:55.330956 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:55.331005 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 11:05:55.331035 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:05:55.338948 7384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:55.339072 7384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41552:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:05:55.339805 7384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6a491066a3a4e34837950ee09a04474: Sending DeleteTablet for 3 replicas of tablet db5765301d244377970f082f110a6801
I20260811 11:05:55.340086 7904 tablet_service.cc:1514] Processing DeleteTablet for tablet db5765301d244377970f082f110a6801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:50682
I20260811 11:05:55.340086 8209 tablet_service.cc:1514] Processing DeleteTablet for tablet db5765301d244377970f082f110a6801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33608
I20260811 11:05:55.340186 8429 tablet_replica.cc:330] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: stopping tablet replica
I20260811 11:05:55.340168 7642 tablet_service.cc:1514] Processing DeleteTablet for tablet db5765301d244377970f082f110a6801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:05:55 UTC) from {username='oryx', principal='oryx/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:55612
I20260811 11:05:55.340236 8429 raft_consensus.cc:2229] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:05:55.340255 8430 tablet_replica.cc:330] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556: stopping tablet replica
I20260811 11:05:55.340309 8430 raft_consensus.cc:2229] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:55.340313 8429 raft_consensus.cc:2258] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:55.340353 8430 raft_consensus.cc:2258] T db5765301d244377970f082f110a6801 P 3ccd15ea8b5d42c98221248ec06dc556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:55.340387 8432 tablet_replica.cc:330] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: stopping tablet replica
I20260811 11:05:55.340456 8432 raft_consensus.cc:2229] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:05:55.340500 8432 raft_consensus.cc:2258] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:05:55.340669 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 7512
I20260811 11:05:55.349377 8432 ts_tablet_manager.cc:1905] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:55.350713 8429 ts_tablet_manager.cc:1905] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:05:55.351902 8429 ts_tablet_manager.cc:1918] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:55.351967 8429 log.cc:1196] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/db5765301d244377970f082f110a6801
I20260811 11:05:55.352188 8429 ts_tablet_manager.cc:1939] T db5765301d244377970f082f110a6801 P a48c2877911b4fbba4b687a832fa2118: Deleting consensus metadata
I20260811 11:05:55.352566 7366 catalog_manager.cc:4841] TS a48c2877911b4fbba4b687a832fa2118 (127.25.227.2:36909): tablet db5765301d244377970f082f110a6801 (table test-table [id=ddcfe6c95b8444699f8df80720c24c2a]) successfully deleted
I20260811 11:05:55.357383 8432 ts_tablet_manager.cc:1918] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 11:05:55.357455 8432 log.cc:1196] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/db5765301d244377970f082f110a6801
I20260811 11:05:55.357689 8432 ts_tablet_manager.cc:1939] T db5765301d244377970f082f110a6801 P ac6ae78fa0e94b77ba8429131f6ddb66: Deleting consensus metadata
I20260811 11:05:55.358177 7366 catalog_manager.cc:4841] TS ac6ae78fa0e94b77ba8429131f6ddb66 (127.25.227.3:34965): tablet db5765301d244377970f082f110a6801 (table test-table [id=ddcfe6c95b8444699f8df80720c24c2a]) successfully deleted
W20260811 11:05:55.359139 7363 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:46407 (error 108)
I20260811 11:05:55.359450 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 7777
I20260811 11:05:55.364326 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:55.359536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:46407 (local address 127.0.0.1:55648)
0811 11:05:55.364211 (+ 4675us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:55.364272 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:46407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4653,"thread_start_us":49,"threads_started":1}
W20260811 11:05:55.369824 7363 catalog_manager.cc:4584] TS 3ccd15ea8b5d42c98221248ec06dc556 (127.25.227.1:46407): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet db5765301d244377970f082f110a6801: Network error: Client connection negotiation failed: client connection to 127.25.227.1:46407: connect: Connection refused (error 111)
I20260811 11:05:55.376928 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 8065
I20260811 11:05:55.386737 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 7328
2026-08-11T11:05:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3066 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[8559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[8559](info): set up 2 sockets
Aug 11 11:05:55 dist-test-slave-z8x9 krb5kdc[8559](info): commencing operation
krb5kdc: starting...
W20260811 11:05:56.703358 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:56 dist-test-slave-z8x9 krb5kdc[8559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:56.824937 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35995
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:40545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:56.910399 8579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:56.910666 8579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:56.910712 8579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:56.912024 8579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:56.912079 8579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:56.912106 8579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:56.912138 8579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:56.912204 8579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:56.913975 8579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:40545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:56.914256 8579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:56.914515 8579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:56.919773 8591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:56.919768 8589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:56.919791 8593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:56.920059 8579 server_base.cc:1034] running on GCE node
I20260811 11:05:56.920352 8579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:56.920641 8579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:56.921783 8579 hybrid_clock.cc:648] HybridClock initialized: now 1786446356921772 us; error 29 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T11:05:56Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1536 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:05:56 dist-test-slave-z8x9 krb5kdc[8602](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:05:56 dist-test-slave-z8x9 krb5kdc[8602](info): set up 2 sockets
Aug 11 11:05:56 dist-test-slave-z8x9 krb5kdc[8602](info): commencing operation
krb5kdc: starting...
W20260811 11:05:58.224993 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:05:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:05:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:05:58.349373 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45677
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:45677
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:58.434927 8626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:58.435173 8626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:58.435211 8626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:58.436358 8626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:58.436426 8626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:58.436450 8626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:58.436473 8626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:58.436503 8626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:58.438030 8626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:45677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:58.438314 8626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:58.438544 8626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:58.443531 8634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:58.443514 8636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:58.443531 8642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:58.443693 8626 server_base.cc:1034] running on GCE node
I20260811 11:05:58.444073 8626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:58.444394 8626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:58.445561 8626 hybrid_clock.cc:648] HybridClock initialized: now 1786446358445540 us; error 39 us; skew 500 ppm
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:58.448077 8626 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:58.448570 8626 webserver.cc:460] Webserver started at http://127.25.227.62:44055/ using document root <none> and password file <none>
I20260811 11:05:58.448807 8626 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:58.448879 8626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:58.449036 8626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:58.450194 8626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "f1953e15b1d5451eb4322adfade7c671"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "7e2bc9d83ed1694c7943d6ce42b03d3c"
server_key_iv: "2f5758f86543da2e41a2cae9a8aea2bc"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.450579 8626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "f1953e15b1d5451eb4322adfade7c671"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "7e2bc9d83ed1694c7943d6ce42b03d3c"
server_key_iv: "2f5758f86543da2e41a2cae9a8aea2bc"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.452067 8626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:05:58.452880 8657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.453105 8626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:58.453229 8626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "f1953e15b1d5451eb4322adfade7c671"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "7e2bc9d83ed1694c7943d6ce42b03d3c"
server_key_iv: "2f5758f86543da2e41a2cae9a8aea2bc"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.453331 8626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:58.477752 8626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:58.479750 8626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:58.479928 8626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:58.484316 8626 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:45677
I20260811 11:05:58.484356 8762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:45677 every 8 connection(s)
I20260811 11:05:58.484762 8626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:58.485201 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 8626
I20260811 11:05:58.485373 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:05:58.485594 26508 external_mini_cluster.cc:1428] Setting key 5401e3f214fb43665369fce4689a1716
I20260811 11:05:58.485864 8763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:05:58.488689 8763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Bootstrap starting.
I20260811 11:05:58.489421 8763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Neither blocks nor log segments found. Creating new log.
I20260811 11:05:58.489727 8763 log.cc:824] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:58.490511 8763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: No bootstrap required, opened a new log
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:58.492817 8763 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:58.492978 8763 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:05:58.493005 8763 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1953e15b1d5451eb4322adfade7c671, State: Initialized, Role: FOLLOWER
I20260811 11:05:58.493155 8763 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:58.493292 8763 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:58.493338 8763 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:58.493389 8763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:05:58.493937 8763 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:58.494058 8763 leader_election.cc:302] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1953e15b1d5451eb4322adfade7c671; no voters:
I20260811 11:05:58.494244 8763 leader_election.cc:288] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:05:58.494323 8773 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:05:58.494481 8773 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 LEADER]: Becoming Leader. State: Replica: f1953e15b1d5451eb4322adfade7c671, State: Running, Role: LEADER
I20260811 11:05:58.494638 8773 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:58.495124 8775 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1953e15b1d5451eb4322adfade7c671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } } }
I20260811 11:05:58.494553 8763 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:58.495275 8775 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:58.495151 8776 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1953e15b1d5451eb4322adfade7c671. Latest consensus state: current_term: 1 leader_uuid: "f1953e15b1d5451eb4322adfade7c671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } } }
I20260811 11:05:58.496635 8776 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:58.496829 8792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:58.496990 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.486158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45188 (local address 127.25.227.62:45677)
0811 11:05:58.486378 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:58.486386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:58.486411 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:05:58.486954 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:58.486961 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:58.487007 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:58.487159 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:58.487827 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.488710 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.489591 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.490064 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.490156 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:58.492896 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:58.492901 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:58.492901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:58.492912 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:58.495213 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:58.495623 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:58.495626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:58.495627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:58.495741 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:58.495972 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:58.495973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:58.495974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:58.496220 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:58.496387 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:58.496519 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 11:05:58.496689 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":105,"threads_started":1}
I20260811 11:05:58.497786 8792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:58.499377 8792 catalog_manager.cc:1347] Generated new cluster ID: fb249f40b5984eef812905ed2d006a14
I20260811 11:05:58.499429 8792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:58.505376 8792 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:05:58.506078 8792 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:58.510740 8792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Generated new TSK 0
I20260811 11:05:58.510931 8792 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:05:58.539678 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45677
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:58.624818 8803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:58.625051 8803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:58.625092 8803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:58.626297 8803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:58.626366 8803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:58.626412 8803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:58.627874 8803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:58.628142 8803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:58.628374 8803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:58.633486 8813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:58.633486 8815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:58.633481 8818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:58.633816 8803 server_base.cc:1034] running on GCE node
I20260811 11:05:58.634054 8803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:58.634296 8803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:58.635447 8803 hybrid_clock.cc:648] HybridClock initialized: now 1786446358635435 us; error 30 us; skew 500 ppm
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:58.638052 8803 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:05:58.638537 8803 webserver.cc:460] Webserver started at http://127.25.227.1:46713/ using document root <none> and password file <none>
I20260811 11:05:58.638778 8803 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:58.638849 8803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:58.639008 8803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:58.640033 8803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "9bfe46df01424580bfd7bd2ee30220c5"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "fdfef035e6e4cfe96e2ec81b2e68ef28"
server_key_iv: "89bf7126adf0ca042a74bd684ef6c19d"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.640395 8803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "9bfe46df01424580bfd7bd2ee30220c5"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "fdfef035e6e4cfe96e2ec81b2e68ef28"
server_key_iv: "89bf7126adf0ca042a74bd684ef6c19d"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.641819 8803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:05:58.642541 8836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.642732 8803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.642845 8803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "9bfe46df01424580bfd7bd2ee30220c5"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "fdfef035e6e4cfe96e2ec81b2e68ef28"
server_key_iv: "89bf7126adf0ca042a74bd684ef6c19d"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.642921 8803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:58.652199 8803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:58.654225 8803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:58.654390 8803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:58.654613 8803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:58.654938 8803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:58.655000 8803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.655043 8803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:58.655072 8803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.662174 8803 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:34039
I20260811 11:05:58.662231 9037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:34039 every 8 connection(s)
I20260811 11:05:58.662652 8803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:58.665454 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 8803
I20260811 11:05:58.665567 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:05:58.665781 26508 external_mini_cluster.cc:1428] Setting key d7d4da1fcccee5c34404e2310442c502
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:58.675812 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.664416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:43197 (local address 127.25.227.62:45677)
0811 11:05:58.664483 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:58.664486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:58.665161 (+ 675us) server_negotiation.cc:407] Connection header received
0811 11:05:58.665984 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:58.665986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:58.666027 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:58.666117 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:58.667395 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.668439 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.669912 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.670236 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.670309 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:58.672519 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:58.672521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:58.672522 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:58.672531 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:58.674279 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:58.674688 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:58.674690 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:58.674690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:58.674769 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:58.675072 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:58.675073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:58.675073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:58.675228 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:58.675303 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:58.675565 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 11:05:58.675663 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:05:58.675828 9045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.664343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:43197)
0811 11:05:58.665021 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:58.665071 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:58.665753 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:58.666171 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:58.666175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:58.666966 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:58.667258 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:58.667265 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.668563 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.668564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:58.669808 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:58.669811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.670330 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.670331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:58.670442 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:58.671022 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:58.671030 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:58.672421 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:58.674376 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:58.674383 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:58.674385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:58.674609 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:58.674872 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:58.674874 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:58.674874 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:58.674992 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:58.675299 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:58.675304 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:58.675424 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 11:05:58.675510 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 11:05:58.675639 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
I20260811 11:05:58.676476 9039 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45677
I20260811 11:05:58.676597 9039 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:58.676787 9039 heartbeater.cc:511] Master 127.25.227.62:45677 requested a full tablet report, sending...
I20260811 11:05:58.677385 8690 ts_manager.cc:194] Registered new tserver with Master: 9bfe46df01424580bfd7bd2ee30220c5 (127.25.227.1:34039)
I20260811 11:05:58.678009 8690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:43197
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:05:58.693982 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45677
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:58.777386 9048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:58.777595 9048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:58.777619 9048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:58.778867 9048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:58.778923 9048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:58.778950 9048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:58.780501 9048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:58.780787 9048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:58.781050 9048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:58.786461 9062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:58.786455 9065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:58.786496 9048 server_base.cc:1034] running on GCE node
W20260811 11:05:58.786464 9061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:58.786967 9048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:58.787254 9048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:58.788425 9048 hybrid_clock.cc:648] HybridClock initialized: now 1786446358788420 us; error 35 us; skew 500 ppm
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:58.790980 9048 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:05:58.791455 9048 webserver.cc:460] Webserver started at http://127.25.227.2:39175/ using document root <none> and password file <none>
I20260811 11:05:58.791697 9048 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:58.791769 9048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:58.791927 9048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:58.792994 9048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "2e8603813c454e59b59cd90d5942cc94"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "05cc9212ac4a7a473ab47141477c6095"
server_key_iv: "0c3dffc0eb213817d49d6c1dd1d18a49"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.793399 9048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "2e8603813c454e59b59cd90d5942cc94"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "05cc9212ac4a7a473ab47141477c6095"
server_key_iv: "0c3dffc0eb213817d49d6c1dd1d18a49"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.794770 9048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:58.795615 9080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.795797 9048 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:58.795903 9048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "2e8603813c454e59b59cd90d5942cc94"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "05cc9212ac4a7a473ab47141477c6095"
server_key_iv: "0c3dffc0eb213817d49d6c1dd1d18a49"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.796022 9048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:58.816221 9048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:58.818363 9048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:58.818534 9048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:58.818784 9048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:58.819110 9048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:58.819166 9048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.819213 9048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:58.819239 9048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.824954 9048 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:34555
I20260811 11:05:58.825026 9284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:34555 every 8 connection(s)
I20260811 11:05:58.825423 9048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:58.829677 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 9048
I20260811 11:05:58.829810 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:05:58.830056 26508 external_mini_cluster.cc:1428] Setting key 2fe6b8388660506d109e5b6b6d564abf
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:58.835289 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.826168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43717 (local address 127.25.227.62:45677)
0811 11:05:58.826250 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:58.826253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:58.826417 (+ 164us) server_negotiation.cc:407] Connection header received
0811 11:05:58.826870 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:58.826871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:58.826883 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:58.826937 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:58.827834 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.828329 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.829331 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.829541 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.829599 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:58.832126 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:58.832128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:58.832128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:58.832137 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:58.833886 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:58.834276 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:58.834277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:58.834278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:58.834345 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:58.834579 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:58.834581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:58.834581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:58.834733 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:58.834815 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:58.835063 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 11:05:58.835155 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:05:58.835304 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.826129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:43717)
0811 11:05:58.826292 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:58.826328 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:58.826790 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:58.826987 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:58.826990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:58.827558 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:58.827751 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:58.827765 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.828408 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.828409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:58.829243 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:58.829246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.829634 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.829635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:58.829794 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:58.830442 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:58.830453 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:58.832028 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:58.833965 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:58.833972 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:58.833974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:58.834194 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:58.834412 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:58.834412 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:58.834413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:58.834514 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:58.834809 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:58.834813 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:58.834925 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 11:05:58.835012 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:05:58.835131 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260811 11:05:58.835821 9285 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45677
I20260811 11:05:58.835916 9285 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:58.836107 9285 heartbeater.cc:511] Master 127.25.227.62:45677 requested a full tablet report, sending...
I20260811 11:05:58.836557 8690 ts_manager.cc:194] Registered new tserver with Master: 2e8603813c454e59b59cd90d5942cc94 (127.25.227.2:34555)
I20260811 11:05:58.836937 8690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:43717
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:05:58.864127 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45677
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:58.949380 9293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:58.949581 9293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:58.949604 9293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:58.950691 9293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:58.950728 9293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:58.950753 9293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:58.952124 9293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:58.952318 9293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:58.952503 9293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:58.957650 9302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:58.957669 9307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:58.957877 9293 server_base.cc:1034] running on GCE node
W20260811 11:05:58.957669 9304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:58.958230 9293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:58.958446 9293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:58.959579 9293 hybrid_clock.cc:648] HybridClock initialized: now 1786446358959567 us; error 29 us; skew 500 ppm
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:58.968284 9293 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:05:58.968756 9293 webserver.cc:460] Webserver started at http://127.25.227.3:46305/ using document root <none> and password file <none>
I20260811 11:05:58.969024 9293 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:58.969072 9293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:58.969267 9293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:05:58.970428 9293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "33a4df8650734c20bf33e000569bff4f"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "adf977235d061a9dd3bb8228235ca11c"
server_key_iv: "85f2f73935d387dd45c8fb28a153ccfe"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.970851 9293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "33a4df8650734c20bf33e000569bff4f"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "adf977235d061a9dd3bb8228235ca11c"
server_key_iv: "85f2f73935d387dd45c8fb28a153ccfe"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.972311 9293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:05:58.973076 9321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.973306 9293 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:05:58.973419 9293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "33a4df8650734c20bf33e000569bff4f"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "adf977235d061a9dd3bb8228235ca11c"
server_key_iv: "85f2f73935d387dd45c8fb28a153ccfe"
server_key_version: "encryptionkey@0"
I20260811 11:05:58.973497 9293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:58.984786 9293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:58.986821 9293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:58.986996 9293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:58.987239 9293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:58.987573 9293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:58.987629 9293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.987665 9293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:58.987712 9293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:58.994048 9293 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:36847
I20260811 11:05:58.994102 9540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:36847 every 8 connection(s)
I20260811 11:05:58.994441 9293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:05:59.000061 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 9293
I20260811 11:05:59.000180 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:05:59.000380 26508 external_mini_cluster.cc:1428] Setting key 87d35d09772c30b7f991a80209768b36
Aug 11 11:05:58 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446358, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:05:59.004742 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.995230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:48435 (local address 127.25.227.62:45677)
0811 11:05:58.995304 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:58.995306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:58.995578 (+ 272us) server_negotiation.cc:407] Connection header received
0811 11:05:58.996193 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:58.996195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:58.996208 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:58.996272 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:58.997528 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.998034 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.999167 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.999370 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.999445 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.002154 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:59.002155 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:59.002156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:59.002163 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:59.003495 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:59.003877 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:59.003878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:59.003879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:59.003930 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:59.004204 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:59.004204 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:59.004205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:59.004318 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:59.004369 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:59.004616 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 11:05:59.004677 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:05:59.005028 9546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:58.995221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:48435)
0811 11:05:58.995421 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:58.995478 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:58.996078 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:58.996341 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:58.996345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:58.997151 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:58.997421 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:58.997427 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.998132 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.998133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:58.999066 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:58.999069 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:58.999453 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:58.999454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:58.999595 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.000263 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.000274 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.002071 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:05:59.003574 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:59.003581 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:59.003583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:59.003811 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:59.004021 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:05:59.004022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:05:59.004022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:05:59.004140 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:05:59.004378 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:05:59.004384 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:05:59.004504 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 11:05:59.004591 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:05:59.004718 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260811 11:05:59.005537 9544 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45677
I20260811 11:05:59.005652 9544 heartbeater.cc:464] Registering TS with master...
I20260811 11:05:59.005851 9544 heartbeater.cc:511] Master 127.25.227.62:45677 requested a full tablet report, sending...
I20260811 11:05:59.006255 8690 ts_manager.cc:194] Registered new tserver with Master: 33a4df8650734c20bf33e000569bff4f (127.25.227.3:36847)
I20260811 11:05:59.006639 8690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:48435
I20260811 11:05:59.012228 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab.
Entry for principal oryx/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab.
WARNING: no policy specified for oryx/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab.
Entry for principal oryx/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab.
WARNING: no policy specified for oryx/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab.
Entry for principal oryx/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab.
I20260811 11:05:59.081504 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 8803
I20260811 11:05:59.096582 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 9048
I20260811 11:05:59.109062 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 9293
I20260811 11:05:59.122223 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 8626
I20260811 11:05:59.136500 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45677
--webserver_interface=127.25.227.62
--webserver_port=44055
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:45677
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:05:59.219308 9568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:59.219512 9568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:59.219537 9568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:59.220679 9568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:05:59.220722 9568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:59.220737 9568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:59.220800 9568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:05:59.220830 9568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:05:59.222363 9568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:45677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=44055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:59.222632 9568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:59.222872 9568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:59.227782 9586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:59.227882 9568 server_base.cc:1034] running on GCE node
W20260811 11:05:59.227833 9587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:59.227807 9590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:59.228246 9568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:59.228551 9568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:59.229734 9568 hybrid_clock.cc:648] HybridClock initialized: now 1786446359229721 us; error 37 us; skew 500 ppm
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446359, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:59.232221 9568 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:05:59.232717 9568 webserver.cc:460] Webserver started at http://127.25.227.62:44055/ using document root <none> and password file <none>
I20260811 11:05:59.232967 9568 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:59.233052 9568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:59.234483 9568 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:59.235162 9605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.235344 9568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:59.235452 9568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "f1953e15b1d5451eb4322adfade7c671"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "7e2bc9d83ed1694c7943d6ce42b03d3c"
server_key_iv: "2f5758f86543da2e41a2cae9a8aea2bc"
server_key_version: "encryptionkey@0"
I20260811 11:05:59.235786 9568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:59.244066 9568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:59.246003 9568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:59.246165 9568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:59.250494 9568 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:45677
I20260811 11:05:59.250559 9702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:45677 every 8 connection(s)
I20260811 11:05:59.250946 9568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:05:59.251499 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 9568
I20260811 11:05:59.251785 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:34039
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:45677
--webserver_port=46713
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:05:59.252591 9703 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:05:59.253319 9703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Bootstrap starting.
I20260811 11:05:59.262600 9703 log.cc:824] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Log is configured to *not* fsync() on all Append() calls
I20260811 11:05:59.264272 9703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:05:59.264565 9703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Bootstrap complete.
I20260811 11:05:59.266893 9703 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:59.267136 9703 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1953e15b1d5451eb4322adfade7c671, State: Initialized, Role: FOLLOWER
I20260811 11:05:59.267323 9703 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:59.267402 9703 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:05:59.267455 9703 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:05:59.267504 9703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:05:59.268464 9703 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:59.268586 9703 leader_election.cc:302] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1953e15b1d5451eb4322adfade7c671; no voters:
I20260811 11:05:59.268790 9703 leader_election.cc:288] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:05:59.268833 9708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:05:59.268953 9708 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [term 2 LEADER]: Becoming Leader. State: Replica: f1953e15b1d5451eb4322adfade7c671, State: Running, Role: LEADER
I20260811 11:05:59.269075 9703 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:05:59.269110 9708 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } }
I20260811 11:05:59.269495 9709 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f1953e15b1d5451eb4322adfade7c671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } } }
I20260811 11:05:59.269584 9709 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:59.269824 9711 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1953e15b1d5451eb4322adfade7c671. Latest consensus state: current_term: 2 leader_uuid: "f1953e15b1d5451eb4322adfade7c671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1953e15b1d5451eb4322adfade7c671" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45677 } } }
I20260811 11:05:59.269913 9711 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671 [sys.catalog]: This master's current role is: LEADER
I20260811 11:05:59.271040 9739 catalog_manager.cc:1259] Loaded cluster ID: fb249f40b5984eef812905ed2d006a14
I20260811 11:05:59.271091 9739 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: loading cluster ID for follower catalog manager: success
I20260811 11:05:59.272272 9739 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: acquiring CA information for follower catalog manager: success
I20260811 11:05:59.272614 9739 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:05:59.272691 9721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:05:59.272852 9721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:05:59.272929 9721 catalog_manager.cc:1259] Loaded cluster ID: fb249f40b5984eef812905ed2d006a14
I20260811 11:05:59.272953 9721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:05:59.273120 9721 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:05:59.273243 9721 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f1953e15b1d5451eb4322adfade7c671: Loaded TSK: 0
I20260811 11:05:59.273381 9721 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:05:59.337590 9706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:59.337801 9706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:59.337826 9706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:59.339098 9706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:59.339146 9706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:59.339174 9706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:05:59.340674 9706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.1.keytab
--principal=oryx/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:34039
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=46713
--tserver_master_addrs=127.25.227.62:45677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:59.340914 9706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:59.341200 9706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:59.347249 9756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:59.347189 9755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:59.347225 9765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:59.347577 9706 server_base.cc:1034] running on GCE node
I20260811 11:05:59.347802 9706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:59.348086 9706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:59.349243 9706 hybrid_clock.cc:648] HybridClock initialized: now 1786446359349224 us; error 35 us; skew 500 ppm
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446359, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:59.351794 9706 init.cc:377] Logged in from keytab as oryx/127.25.227.1@KRBTEST.COM (short username oryx)
I20260811 11:05:59.352305 9706 webserver.cc:460] Webserver started at http://127.25.227.1:46713/ using document root <none> and password file <none>
I20260811 11:05:59.352557 9706 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:59.352614 9706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:59.354049 9706 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:59.354683 9774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.354856 9706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:59.354964 9706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "9bfe46df01424580bfd7bd2ee30220c5"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "fdfef035e6e4cfe96e2ec81b2e68ef28"
server_key_iv: "89bf7126adf0ca042a74bd684ef6c19d"
server_key_version: "encryptionkey@0"
I20260811 11:05:59.355309 9706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:59.371766 9706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:59.373970 9706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:59.374116 9706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:59.374409 9706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:59.374788 9706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:59.374835 9706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.374861 9706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:59.374874 9706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.382527 9706 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:34039
I20260811 11:05:59.382604 10004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:34039 every 8 connection(s)
I20260811 11:05:59.382974 9706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:05:59.388089 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 9706
I20260811 11:05:59.388439 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:34555
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:45677
--webserver_port=39175
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.393127 10008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.383807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:44253)
0811 11:05:59.384000 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.384050 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.384539 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.385002 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.385007 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.385674 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.385868 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.385872 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.387587 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.387587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.388459 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.388462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.389159 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.389160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.389308 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.389886 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.389896 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.392923 (+ 3027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
W20260811 11:05:59.393337 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.383865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:44253 (local address 127.25.227.62:45677)
0811 11:05:59.384106 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.384115 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.384159 (+ 44us) server_negotiation.cc:407] Connection header received
0811 11:05:59.384757 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.384764 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.384819 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.384956 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.385991 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.387469 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.388587 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.389054 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.389202 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.393090 (+ 3888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:44253: BlockingRecv error: recv got EOF from 127.25.227.1:44253 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":106,"threads_started":1}
W20260811 11:05:59.393646 10005 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:45677 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.227.62:45677: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.399564 10008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.393946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:50193)
0811 11:05:59.394036 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.394048 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.394101 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.394247 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.394248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.394401 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.394455 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.394457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.395432 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.395433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.396279 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.396281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.396790 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.396791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.396855 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.397426 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.397431 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.399502 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 11:05:59.399695 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.393993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:50193 (local address 127.25.227.62:45677)
0811 11:05:59.394042 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.394045 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.394088 (+ 43us) server_negotiation.cc:407] Connection header received
0811 11:05:59.394156 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.394157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.394174 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.394239 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.394536 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.395343 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.396373 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.396704 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.396784 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.399618 (+ 2834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:50193: BlockingRecv error: recv got EOF from 127.25.227.1:50193 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.405009 10008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.399980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:58019)
0811 11:05:59.400127 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.400136 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.400181 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.400325 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.400326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.400464 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.400497 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.400498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.401463 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.401464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.402197 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.402200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.402662 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.402663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.402702 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.403152 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.403156 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.404935 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
W20260811 11:05:59.405092 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.400051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:58019 (local address 127.25.227.62:45677)
0811 11:05:59.400111 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.400113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.400188 (+ 75us) server_negotiation.cc:407] Connection header received
0811 11:05:59.400222 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.400223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.400235 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.400311 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.400575 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.401362 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.402291 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.402589 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.402659 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.405017 (+ 2358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:58019: BlockingRecv error: recv got EOF from 127.25.227.1:58019 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 11:05:59.405139 10005 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:05:59.476342 10010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:59.476540 10010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:59.476563 10010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:59.477676 10010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:59.477713 10010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:59.477739 10010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:05:59.479107 10010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.2.keytab
--principal=oryx/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:34555
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=39175
--tserver_master_addrs=127.25.227.62:45677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:59.479290 10010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:59.479473 10010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:59.484615 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:59.484638 10024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:59.484789 10010 server_base.cc:1034] running on GCE node
W20260811 11:05:59.484944 10023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:59.485225 10010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:59.487720 10010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:59.488907 10010 hybrid_clock.cc:648] HybridClock initialized: now 1786446359488884 us; error 38 us; skew 500 ppm
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446359, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:59.491643 10010 init.cc:377] Logged in from keytab as oryx/127.25.227.2@KRBTEST.COM (short username oryx)
I20260811 11:05:59.492138 10010 webserver.cc:460] Webserver started at http://127.25.227.2:39175/ using document root <none> and password file <none>
I20260811 11:05:59.492398 10010 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:59.492483 10010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:59.493922 10010 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:05:59.494534 10045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.494763 10010 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:59.494885 10010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "2e8603813c454e59b59cd90d5942cc94"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "05cc9212ac4a7a473ab47141477c6095"
server_key_iv: "0c3dffc0eb213817d49d6c1dd1d18a49"
server_key_version: "encryptionkey@0"
I20260811 11:05:59.495219 10010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:59.512293 10010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:59.514683 10010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:59.514858 10010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:59.515094 10010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:59.515403 10010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:59.515458 10010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.515501 10010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:59.515528 10010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.521590 10010 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:34555
I20260811 11:05:59.521643 10284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:34555 every 8 connection(s)
I20260811 11:05:59.521984 10010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:05:59.525228 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 10010
I20260811 11:05:59.525540 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:36847
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:45677
--webserver_port=46305
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:05:59.530181 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.522704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:38193 (local address 127.25.227.62:45677)
0811 11:05:59.522775 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.522777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.523028 (+ 251us) server_negotiation.cc:407] Connection header received
0811 11:05:59.523563 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.523564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.523581 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.523627 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.524561 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.525061 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.526248 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.526444 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.526535 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.530132 (+ 3597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:38193: BlockingRecv error: recv got EOF from 127.25.227.2:38193 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:05:59.530316 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.522672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:38193)
0811 11:05:59.522877 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.522936 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.523450 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.523707 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.523711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.524281 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.524461 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.524466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.525161 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.525162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.526158 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.526161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.526560 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.526561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.526690 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.527260 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.527273 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.530054 (+ 2781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":112,"threads_started":1}
W20260811 11:05:59.530607 10285 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:45677 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.227.62:45677: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.535615 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.530855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:37523)
0811 11:05:59.530903 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.530914 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.530952 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.531079 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.531080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.531246 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.531307 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.531309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.531900 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.531902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.532810 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.532813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.533131 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.533133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.533231 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.533614 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.533621 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.535532 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 11:05:59.535670 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.530905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:37523 (local address 127.25.227.62:45677)
0811 11:05:59.530942 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.530943 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.530959 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:05:59.531014 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.531015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.531023 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.531070 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.531389 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.531824 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.532892 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.533059 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.533108 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.535605 (+ 2497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:37523: BlockingRecv error: recv got EOF from 127.25.227.2:37523 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.540107 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.535938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:37685)
0811 11:05:59.536025 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.536037 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.536083 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.536208 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.536208 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.536334 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.536359 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.536360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.536961 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.536962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.537542 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.537544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.537910 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.537911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.537964 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.538388 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.538394 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.540024 (+ 1630us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 11:05:59.540158 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.535982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:37685 (local address 127.25.227.62:45677)
0811 11:05:59.536029 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.536032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.536069 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:05:59.536139 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.536140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.536149 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.536203 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.536432 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.536882 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.537627 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.537853 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.537912 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.540094 (+ 2182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:37685: BlockingRecv error: recv got EOF from 127.25.227.2:37685 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 11:05:59.540277 10285 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:05:59.612859 10288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:05:59.613161 10288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:05:59.613236 10288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:05:59.614531 10288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:05:59.614579 10288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:05:59.614606 10288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:05:59.616058 10288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/krb5kdc/oryx_127.25.227.3.keytab
--principal=oryx/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:36847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=46305
--tserver_master_addrs=127.25.227.62:45677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:05:59.616271 10288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:05:59.616463 10288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:05:59.621656 10311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:59.621666 10305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:05:59.621768 10303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:05:59.621891 10288 server_base.cc:1034] running on GCE node
I20260811 11:05:59.622184 10288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:05:59.622426 10288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:05:59.623615 10288 hybrid_clock.cc:648] HybridClock initialized: now 1786446359623593 us; error 50 us; skew 500 ppm
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446359, etypes {rep=17 tkt=17 ses=17}, oryx/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:05:59.626230 10288 init.cc:377] Logged in from keytab as oryx/127.25.227.3@KRBTEST.COM (short username oryx)
I20260811 11:05:59.626740 10288 webserver.cc:460] Webserver started at http://127.25.227.3:46305/ using document root <none> and password file <none>
I20260811 11:05:59.626981 10288 fs_manager.cc:359] Metadata directory not provided
I20260811 11:05:59.627063 10288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:05:59.628415 10288 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:05:59.629004 10329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.629215 10288 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:05:59.629326 10288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "33a4df8650734c20bf33e000569bff4f"
format_stamp: "Formatted at 2026-08-11 11:05:58 on dist-test-slave-z8x9"
server_key: "adf977235d061a9dd3bb8228235ca11c"
server_key_iv: "85f2f73935d387dd45c8fb28a153ccfe"
server_key_version: "encryptionkey@0"
I20260811 11:05:59.629678 10288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:05:59.662966 10288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:05:59.664937 10288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:05:59.665113 10288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:05:59.665400 10288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:05:59.665727 10288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:05:59.665786 10288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.665832 10288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:05:59.665858 10288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:05:59.672191 10288 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:36847
I20260811 11:05:59.672310 10566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:36847 every 8 connection(s)
I20260811 11:05:59.672637 10288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 11:05:59.680027 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.673432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:43213 (local address 127.25.227.62:45677)
0811 11:05:59.673497 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.673499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.673729 (+ 230us) server_negotiation.cc:407] Connection header received
0811 11:05:59.674255 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.674257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.674271 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.674329 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.675319 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.675816 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.676827 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.677025 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.677102 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.679978 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:43213: BlockingRecv error: recv got EOF from 127.25.227.3:43213 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:05:59.680042 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.673422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:43213)
0811 11:05:59.673606 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.673642 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.674145 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.674408 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.674413 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.675007 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.675201 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.675205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.675914 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.675916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.676724 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.676726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.677135 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.677136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.677284 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.677762 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.677771 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.679894 (+ 2123us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":96,"threads_started":1}
W20260811 11:05:59.680322 10568 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:45677 (0 consecutive failures): Not authorized: Failed to ping master at 127.25.227.62:45677: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
I20260811 11:05:59.682407 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 10288
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.684970 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.680547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:56931)
0811 11:05:59.680605 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.680617 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.680662 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.680909 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.680910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.681034 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.681076 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.681078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.681726 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.681727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.682212 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.682214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.682637 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.682638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.682709 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.683074 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.683078 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.684927 (+ 1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 11:05:59.685081 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.680748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:56931 (local address 127.25.227.62:45677)
0811 11:05:59.680798 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.680800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.680806 (+ 6us) server_negotiation.cc:407] Connection header received
0811 11:05:59.680823 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.680824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.680832 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.680890 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.681150 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.681631 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.682318 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.682557 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.682637 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.685024 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:56931: BlockingRecv error: recv got EOF from 127.25.227.3:56931 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:05:59 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:05:59.689719 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.685427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:41499)
0811 11:05:59.685483 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 11:05:59.685493 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:05:59.685534 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:05:59.685678 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:05:59.685679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:05:59.685835 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:05:59.685864 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.685866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.686647 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.686648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.687125 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:05:59.687126 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.687485 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.687487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:05:59.687544 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.687845 (+ 301us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:05:59.687851 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:05:59.689645 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 11:05:59.689816 10009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:05:59.685499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:41499 (local address 127.25.227.62:45677)
0811 11:05:59.685534 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.685536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.685570 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:05:59.685591 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.685591 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.685601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.685652 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.685936 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.686558 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.687213 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.687412 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.687459 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.689706 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:41499: BlockingRecv error: recv got EOF from 127.25.227.3:41499 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 11:05:59.689867 10568 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:05:59.690559 10573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:05:59.682773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45196 (local address 127.25.227.62:45677)
0811 11:05:59.682896 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 11:05:59.682897 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:05:59.683274 (+ 377us) server_negotiation.cc:407] Connection header received
0811 11:05:59.683321 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:05:59.683322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:05:59.683332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:05:59.683390 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:05:59.684084 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.684678 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.685678 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:05:59.685999 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:05:59.686050 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:05:59.687238 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:05:59.687243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:05:59.687244 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:05:59.687270 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:05:59.688950 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:59.689374 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:59.689377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:59.689377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:59.689489 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:05:59.689722 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:05:59.689723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:05:59.689724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:05:59.690064 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:05:59.690228 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 11:05:59.690346 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:05:59.690456 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":82,"threads_started":1}
Aug 11 11:06:00 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:00 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:00.410696 10580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:00.405609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:47011)
0811 11:06:00.405877 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:00.405893 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:00.405964 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:00.406108 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:00.406108 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:00.406287 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:00.406336 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:00.406338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.406977 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.406978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:00.407532 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:00.407534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.407887 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.407888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:00.407935 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:00.408509 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:00.408514 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:00.410625 (+ 2111us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":73,"threads_started":1}
W20260811 11:06:00.410841 10581 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:00.405681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:47011 (local address 127.25.227.62:45677)
0811 11:06:00.405954 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:00.405956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:00.405966 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:06:00.406012 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:00.406013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:00.406025 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:00.406083 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:00.406404 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.406903 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.407605 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.407813 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.407870 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:00.410746 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:47011: BlockingRecv error: recv got EOF from 127.25.227.1:47011 (error 108)
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":84,"threads_started":1}
Aug 11 11:06:00 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:00 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:00.545557 10582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:00.540669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:48835)
0811 11:06:00.540854 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:00.540869 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:00.540961 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:00.541094 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:00.541094 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:00.541313 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:00.541368 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:00.541370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.542068 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.542069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:00.542671 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:00.542673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.543075 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.543076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:00.543132 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:00.543595 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:00.543600 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:00.545447 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
W20260811 11:06:00.545614 10581 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:00.540771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:48835 (local address 127.25.227.62:45677)
0811 11:06:00.540860 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:00.540862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:00.540943 (+ 81us) server_negotiation.cc:407] Connection header received
0811 11:06:00.541017 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:00.541018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:00.541032 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:00.541088 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:00.541455 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.541969 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.542779 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.542997 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.543077 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:00.545545 (+ 2468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:48835: BlockingRecv error: recv got EOF from 127.25.227.2:48835 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 11 11:06:00 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:00 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:00.695219 10583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:00.690345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:35219)
0811 11:06:00.690517 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:00.690528 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:00.690595 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:00.690718 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:00.690719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:00.690897 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:00.690946 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:00.690948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.691565 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.691565 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:00.692200 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:00.692203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.692623 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.692624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:00.692673 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:00.693234 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:00.693240 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:00.695103 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
W20260811 11:06:00.695261 10581 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:00.690410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35219 (local address 127.25.227.62:45677)
0811 11:06:00.690501 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:00.690503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:00.690592 (+ 89us) server_negotiation.cc:407] Connection header received
0811 11:06:00.690640 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:00.690641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:00.690653 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:00.690706 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:00.691006 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.691495 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.692318 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:00.692548 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:00.692619 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:00.695193 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:35219: BlockingRecv error: recv got EOF from 127.25.227.3:35219 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 11:06:01 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:01 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:01.416051 10586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:01.411245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:57021)
0811 11:06:01.411400 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:01.411411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:01.411465 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:01.411626 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:01.411627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:01.411798 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:01.411850 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:01.411851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.412668 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.412669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:01.413206 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:01.413208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.413547 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.413548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:01.413590 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:01.414064 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:01.414069 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:01.415990 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
W20260811 11:06:01.416184 10595 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:01.411359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:57021 (local address 127.25.227.62:45677)
0811 11:06:01.411495 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:01.411497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:01.411504 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:06:01.411526 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:01.411527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:01.411537 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:01.411604 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:01.412087 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.412595 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.413285 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.413477 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.413535 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:01.416092 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:57021: BlockingRecv error: recv got EOF from 127.25.227.1:57021 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
Aug 11 11:06:01 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:01 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:01.551062 10597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:01.546066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:60055)
0811 11:06:01.546206 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:01.546221 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:01.546305 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:01.546433 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:01.546434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:01.546619 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:01.546668 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:01.546670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.547371 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.547373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:01.547908 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:01.547909 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.548301 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.548302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:01.548369 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:01.548936 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:01.548942 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:01.551000 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
W20260811 11:06:01.551155 10595 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:01.546210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:60055 (local address 127.25.227.62:45677)
0811 11:06:01.546301 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:01.546303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:01.546314 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:06:01.546366 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:01.546368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:01.546380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:01.546430 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:01.546752 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.547271 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.547998 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.548202 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.548297 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:01.551104 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:60055: BlockingRecv error: recv got EOF from 127.25.227.2:60055 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 11:06:01 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:01 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:01.700582 10598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:01.695677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:34683)
0811 11:06:01.695808 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:01.695819 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:01.695878 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:01.696018 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:01.696019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:01.696206 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:01.696254 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:01.696256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.696930 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.696931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:01.697549 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:01.697551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.698080 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.698081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:01.698144 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:01.698601 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:01.698605 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:01.700481 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
W20260811 11:06:01.700634 10595 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:01.695797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:34683 (local address 127.25.227.62:45677)
0811 11:06:01.695852 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:01.695854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:01.695863 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:06:01.695940 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:01.695941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:01.695956 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:01.696012 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:01.696343 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.696847 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.697680 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:01.698005 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:01.698080 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:01.700565 (+ 2485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:34683: BlockingRecv error: recv got EOF from 127.25.227.3:34683 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 11:06:02 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:02 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:02.421468 10599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:02.416608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:42183)
0811 11:06:02.416810 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:02.416821 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:02.416884 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:02.417006 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:02.417007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:02.417295 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:02.417350 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:02.417352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.418033 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.418034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:02.418573 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:02.418575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.418934 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.418934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:02.418976 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:02.419420 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:02.419425 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:02.421377 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":121,"threads_started":1}
W20260811 11:06:02.421593 10600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:02.416730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:42183 (local address 127.25.227.62:45677)
0811 11:06:02.416878 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:02.416879 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:02.416889 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:06:02.416928 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:02.416928 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:02.416939 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:02.417000 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:02.417437 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.417962 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.418660 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.418862 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.418923 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:02.421500 (+ 2577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:42183: BlockingRecv error: recv got EOF from 127.25.227.1:42183 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
Aug 11 11:06:02 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:02 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:02.557088 10601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:02.551675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:33349)
0811 11:06:02.551846 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:02.551862 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:02.551944 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:02.552146 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:02.552147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:02.552379 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:02.552430 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:02.552433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.553355 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.553357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:02.554040 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:02.554043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.554521 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.554522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:02.554572 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:02.555113 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:02.555152 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:02.557026 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
W20260811 11:06:02.557268 10600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:02.551803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:33349 (local address 127.25.227.62:45677)
0811 11:06:02.551881 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:02.551885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:02.551923 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:06:02.552032 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:02.552033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:02.552049 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:02.552135 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:02.552523 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.553238 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.554213 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.554433 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.554506 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:02.557143 (+ 2637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:33349: BlockingRecv error: recv got EOF from 127.25.227.2:33349 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 11:06:02 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:02 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:02.705840 10604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:02.701075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:51687)
0811 11:06:02.701263 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:02.701272 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:02.701326 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:02.701467 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:02.701468 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:02.701641 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:02.701692 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:02.701694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.702365 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.702366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:02.702902 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:02.702904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.703223 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.703224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:02.703267 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:02.703794 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:02.703799 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:02.705741 (+ 1942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":64,"threads_started":1}
W20260811 11:06:02.705907 10600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:02.701159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:51687 (local address 127.25.227.62:45677)
0811 11:06:02.701258 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:02.701260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:02.701327 (+ 67us) server_negotiation.cc:407] Connection header received
0811 11:06:02.701369 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:02.701370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:02.701384 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:02.701443 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:02.701755 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.702271 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.702974 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:02.703159 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:02.703210 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:02.705841 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:51687: BlockingRecv error: recv got EOF from 127.25.227.3:51687 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 11:06:03 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:03 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:03.426867 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:03.422024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:58205)
0811 11:06:03.422192 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:03.422205 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:03.422272 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:03.422468 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:03.422469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:03.422643 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:03.422695 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:03.422696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.423352 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.423353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:03.423880 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:03.423881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.424205 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.424206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:03.424246 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:03.424696 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:03.424701 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:03.426735 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":64,"threads_started":1}
W20260811 11:06:03.426911 10607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:03.422190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:58205 (local address 127.25.227.62:45677)
0811 11:06:03.422345 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:03.422347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:03.422354 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:06:03.422377 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:03.422378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:03.422389 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:03.422448 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:03.422766 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.423281 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.423950 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.424140 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.424190 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:03.426854 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:58205: BlockingRecv error: recv got EOF from 127.25.227.1:58205 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
Aug 11 11:06:03 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:03 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:03.562247 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:03.557619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:58037)
0811 11:06:03.557788 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:03.557800 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:03.557875 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:03.558000 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:03.558001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:03.558173 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:03.558225 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:03.558227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.558934 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.558935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:03.559468 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:03.559470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.559785 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.559786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:03.559825 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:03.560355 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:03.560360 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:03.562185 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
W20260811 11:06:03.562382 10607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:03.557698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:58037 (local address 127.25.227.62:45677)
0811 11:06:03.557796 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:03.557798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:03.557871 (+ 73us) server_negotiation.cc:407] Connection header received
0811 11:06:03.557918 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:03.557919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:03.557932 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:03.557982 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:03.558288 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.558863 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.559541 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.559720 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.559784 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:03.562295 (+ 2511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:58037: BlockingRecv error: recv got EOF from 127.25.227.2:58037 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 11:06:03 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:03 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:03.710894 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:03.706332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:42181)
0811 11:06:03.706509 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:03.706520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:03.706578 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:03.706715 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:03.706716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:03.706892 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:03.706943 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:03.706944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.707567 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.707568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:03.708097 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:03.708098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.708457 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.708458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:03.708505 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:03.709017 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:03.709022 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:03.710832 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":113,"threads_started":1}
W20260811 11:06:03.711038 10607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:03.706398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:42181 (local address 127.25.227.62:45677)
0811 11:06:03.706474 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:03.706476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:03.706579 (+ 103us) server_negotiation.cc:407] Connection header received
0811 11:06:03.706639 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:03.706640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:03.706653 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:03.706695 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:03.707004 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.707496 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.708190 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:03.708388 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:03.708448 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:03.710948 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:42181: BlockingRecv error: recv got EOF from 127.25.227.3:42181 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 11:06:04 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:04 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:04.436216 10610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:04.427365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:57081)
0811 11:06:04.427508 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:04.427519 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:04.427568 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:04.427752 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:04.427753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:04.427917 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:04.427968 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:04.427970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.428675 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.428677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:04.429311 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:04.429314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.429644 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.429645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:04.429684 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:04.434219 (+ 4535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:04.434225 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:04.436153 (+ 1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
W20260811 11:06:04.436371 10612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:04.427466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:57081 (local address 127.25.227.62:45677)
0811 11:06:04.427630 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:04.427632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:04.427640 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:06:04.427662 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:04.427662 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:04.427673 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:04.427734 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:04.428033 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.428583 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.429386 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.429579 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.429634 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:04.436273 (+ 6639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:57081: BlockingRecv error: recv got EOF from 127.25.227.1:57081 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":107,"threads_started":1}
Aug 11 11:06:04 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:04 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:04.567585 10613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:04.562742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:56385)
0811 11:06:04.562892 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:04.562903 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:04.562960 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:04.563077 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:04.563078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:04.563270 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:04.563323 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:04.563325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.563958 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.563959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:04.564501 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:04.564503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.564826 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.564827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:04.564869 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:04.565505 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:04.565510 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:04.567521 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
W20260811 11:06:04.567724 10612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:04.562856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:56385 (local address 127.25.227.62:45677)
0811 11:06:04.562901 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:04.562903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:04.562953 (+ 50us) server_negotiation.cc:407] Connection header received
0811 11:06:04.563002 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:04.563003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:04.563013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:04.563061 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:04.563387 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.563882 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.564576 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.564758 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.564810 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:04.567634 (+ 2824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:56385: BlockingRecv error: recv got EOF from 127.25.227.2:56385 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 11 11:06:04 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:04 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:04.716217 10614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:04.711405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:38573)
0811 11:06:04.711601 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:04.711612 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:04.711664 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:04.711823 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:04.711824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:04.711999 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:04.712052 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:04.712053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.712678 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.712678 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:04.713320 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:04.713323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.713795 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.713796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:04.713861 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:04.714335 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:04.714340 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:04.716158 (+ 1818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":126,"threads_started":1}
W20260811 11:06:04.716470 10612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:04.711511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:38573 (local address 127.25.227.62:45677)
0811 11:06:04.711682 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:04.711684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:04.711696 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:06:04.711723 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:04.711724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:04.711737 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:04.711805 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:04.712120 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.712609 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.713410 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:04.713712 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:04.713790 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:04.716412 (+ 2622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:38573: BlockingRecv error: recv got EOF from 127.25.227.3:38573 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
Aug 11 11:06:05 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:05 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:05.441491 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:05.436731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:54449)
0811 11:06:05.436882 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:05.436896 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:05.436961 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:05.437095 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:05.437096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:05.437324 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:05.437377 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:05.437379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.438028 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.438029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:05.438606 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:05.438608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.438967 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.438967 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:05.439008 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:05.439497 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:05.439502 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:05.441431 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
W20260811 11:06:05.441622 10617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:05.436786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:54449 (local address 127.25.227.62:45677)
0811 11:06:05.436940 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:05.436942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:05.436950 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:06:05.437017 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:05.437018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:05.437029 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:05.437078 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:05.437445 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.437964 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.438680 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.438914 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.438964 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:05.441530 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:54449: BlockingRecv error: recv got EOF from 127.25.227.1:54449 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
Aug 11 11:06:05 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:05 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:05.573486 10618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:05.568176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:43135)
0811 11:06:05.568354 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:05.568369 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:05.568469 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:05.568628 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:05.568630 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:05.568826 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:05.568873 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:05.568875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.569795 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.569797 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:05.570316 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:05.570317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.570810 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.570811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:05.570877 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:05.571311 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:05.571315 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:05.573424 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
W20260811 11:06:05.573653 10617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:05.568301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43135 (local address 127.25.227.62:45677)
0811 11:06:05.568369 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:05.568372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:05.568447 (+ 75us) server_negotiation.cc:407] Connection header received
0811 11:06:05.568530 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:05.568531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:05.568545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:05.568620 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:05.568957 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.569698 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.570401 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.570699 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.570807 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:05.573515 (+ 2708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:43135: BlockingRecv error: recv got EOF from 127.25.227.2:43135 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 11:06:05 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:05 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:05.721562 10620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:05.716777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:47265)
0811 11:06:05.716979 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:05.716993 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:05.717076 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:05.717294 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:05.717296 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:05.717490 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:05.717538 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:05.717540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.718220 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.718222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:05.718764 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:05.718766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.719160 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.719161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:05.719228 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:05.719690 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:05.719695 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:05.721502 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":98,"threads_started":1}
W20260811 11:06:05.721679 10617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:05.716850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:47265 (local address 127.25.227.62:45677)
0811 11:06:05.716946 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:05.716948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:05.717058 (+ 110us) server_negotiation.cc:407] Connection header received
0811 11:06:05.717173 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:05.717194 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:05.717209 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:05.717276 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:05.717623 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.718134 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.718854 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:05.719068 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:05.719156 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:05.721599 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:47265: BlockingRecv error: recv got EOF from 127.25.227.3:47265 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 11:06:06 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:06 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:06.446686 10621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:06.441980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:49957)
0811 11:06:06.442152 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:06.442162 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:06.442211 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:06.442351 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:06.442352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:06.442523 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:06.442574 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:06.442576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.443219 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.443220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:06.443771 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:06.443773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.444154 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.444155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:06.444194 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:06.444761 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:06.444766 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:06.446623 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
W20260811 11:06:06.446849 10622 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:06.442055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:49957 (local address 127.25.227.62:45677)
0811 11:06:06.442200 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:06.442201 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:06.442210 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:06:06.442259 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:06.442259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:06.442271 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:06.442332 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:06.442641 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.443151 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.443875 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.444081 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.444145 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:06.446744 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:49957: BlockingRecv error: recv got EOF from 127.25.227.1:49957 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
Aug 11 11:06:06 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:06 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:06.578738 10623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:06.573928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:59397)
0811 11:06:06.574131 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:06.574150 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:06.574230 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:06.574395 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:06.574396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:06.574595 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:06.574644 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:06.574646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.575335 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.575336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:06.575874 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:06.575876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.576244 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.576245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:06.576302 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:06.576791 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:06.576796 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:06.578677 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":122,"threads_started":1}
W20260811 11:06:06.578871 10622 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:06.574017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:59397 (local address 127.25.227.62:45677)
0811 11:06:06.574107 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:06.574109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:06.574210 (+ 101us) server_negotiation.cc:407] Connection header received
0811 11:06:06.574300 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:06.574303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:06.574319 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:06.574387 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:06.574734 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.575228 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.575962 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.576168 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.576245 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:06.578784 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:59397: BlockingRecv error: recv got EOF from 127.25.227.2:59397 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 11:06:06 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:06 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:06.726930 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:06.722105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:49255)
0811 11:06:06.722290 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:06.722304 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:06.722365 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:06.722504 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:06.722504 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:06.722683 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:06.722737 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:06.722740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.723437 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.723438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:06.723967 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:06.723969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.724314 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.724315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:06.724356 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:06.724830 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:06.724834 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:06.726825 (+ 1991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
W20260811 11:06:06.726984 10622 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:06.722197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:49255 (local address 127.25.227.62:45677)
0811 11:06:06.722281 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:06.722283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:06.722351 (+ 68us) server_negotiation.cc:407] Connection header received
0811 11:06:06.722425 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:06.722426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:06.722439 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:06.722481 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:06.722816 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.723329 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.724048 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:06.724242 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:06.724297 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:06.726914 (+ 2617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:49255: BlockingRecv error: recv got EOF from 127.25.227.3:49255 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 11:06:07 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:07 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:07.452059 10628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:07.447246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:41315)
0811 11:06:07.447453 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:07.447467 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:07.447534 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:07.447667 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:07.447668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:07.447839 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:07.447889 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:07.447891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.448530 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.448531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:07.449039 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:07.449040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.449500 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.449501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:07.449572 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:07.450105 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:07.450110 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:07.451988 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":101,"threads_started":1}
W20260811 11:06:07.452195 10629 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:07.447368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:41315 (local address 127.25.227.62:45677)
0811 11:06:07.447527 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:07.447529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:07.447538 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:06:07.447581 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:07.447581 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:07.447593 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:07.447651 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:07.447955 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.448463 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.449133 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.449404 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.449485 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:07.452085 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:41315: BlockingRecv error: recv got EOF from 127.25.227.1:41315 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
Aug 11 11:06:07 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:07 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:07.583949 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:07.579281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:34597)
0811 11:06:07.579428 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:07.579440 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:07.579509 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:07.579619 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:07.579620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:07.579792 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:07.579842 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:07.579844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.580598 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.580599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:07.581115 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:07.581116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.581544 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.581545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:07.581589 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:07.582057 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:07.582061 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:07.583887 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
W20260811 11:06:07.584096 10629 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:07.579322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:34597 (local address 127.25.227.62:45677)
0811 11:06:07.579388 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:07.579390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:07.579509 (+ 119us) server_negotiation.cc:407] Connection header received
0811 11:06:07.579554 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:07.579555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:07.579565 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:07.579615 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:07.579900 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.580529 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.581275 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.581469 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.581532 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:07.584012 (+ 2480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:34597: BlockingRecv error: recv got EOF from 127.25.227.2:34597 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 11:06:07 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:07 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:07.732602 10635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:07.727505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:38599)
0811 11:06:07.727666 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:07.727679 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:07.727747 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:07.727889 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:07.727889 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:07.728071 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:07.728127 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:07.728129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.728783 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.728784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:07.729398 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:07.729400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.729787 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.729788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:07.729833 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:07.730509 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:07.730515 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:07.732526 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
W20260811 11:06:07.732676 10629 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:07.727618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:38599 (local address 127.25.227.62:45677)
0811 11:06:07.727700 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:07.727702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:07.727734 (+ 32us) server_negotiation.cc:407] Connection header received
0811 11:06:07.727796 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:07.727797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:07.727811 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:07.727866 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:07.728192 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.728700 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.729485 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:07.729675 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:07.729787 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:07.732623 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:38599: BlockingRecv error: recv got EOF from 127.25.227.3:38599 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 11:06:08 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:08 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:08.457231 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:08.452536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:53413)
0811 11:06:08.452681 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:08.452692 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:08.452755 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:08.452903 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:08.452904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:08.453076 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:08.453127 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:08.453129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.453812 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.453813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:08.454364 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:08.454366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.454698 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.454698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:08.454738 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:08.455276 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:08.455281 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:08.457146 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
W20260811 11:06:08.457403 10642 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:08.452620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:53413 (local address 127.25.227.62:45677)
0811 11:06:08.452732 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:08.452735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:08.452743 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:06:08.452825 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:08.452826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:08.452839 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:08.452897 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:08.453231 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.453735 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.454435 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.454628 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.454685 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:08.457314 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:53413: BlockingRecv error: recv got EOF from 127.25.227.1:53413 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":56,"threads_started":1}
Aug 11 11:06:08 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:08 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:08.589473 10643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:08.584469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:56015)
0811 11:06:08.584674 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:08.584685 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:08.584787 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:08.584959 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:08.584961 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:08.585154 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:08.585225 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:08.585227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.585890 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.585892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:08.586432 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:08.586433 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.586790 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.586791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:08.586853 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:08.587330 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:08.587335 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:08.589347 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":115,"threads_started":1}
W20260811 11:06:08.589540 10642 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:08.584550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:56015 (local address 127.25.227.62:45677)
0811 11:06:08.584626 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:08.584628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:08.584768 (+ 140us) server_negotiation.cc:407] Connection header received
0811 11:06:08.584847 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:08.584848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:08.584861 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:08.584927 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:08.585308 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.585808 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.586521 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.586712 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.586789 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:08.589441 (+ 2652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:56015: BlockingRecv error: recv got EOF from 127.25.227.2:56015 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 11:06:08 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:08 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:08.738162 10644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:08.733127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:50465)
0811 11:06:08.733374 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:08.733392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:08.733478 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:08.733629 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:08.733630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:08.733841 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:08.733892 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:08.733894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.734570 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.734571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:08.735106 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:08.735107 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.735471 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.735472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:08.735534 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:08.735991 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:08.735996 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:08.738058 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":166,"threads_started":1}
W20260811 11:06:08.738222 10642 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:08.733263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:50465 (local address 127.25.227.62:45677)
0811 11:06:08.733338 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:08.733340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:08.733459 (+ 119us) server_negotiation.cc:407] Connection header received
0811 11:06:08.733534 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:08.733535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:08.733550 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:08.733622 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:08.733980 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.734486 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.735197 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:08.735395 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:08.735472 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:08.738153 (+ 2681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:50465: BlockingRecv error: recv got EOF from 127.25.227.3:50465 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 11:06:09 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:09 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:09.466786 10645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:09.457725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:46461)
0811 11:06:09.457926 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:09.457939 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:09.458014 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:09.458185 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:09.458185 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:09.458361 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:09.458412 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:09.458414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.459133 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.459134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:09.459719 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:09.459721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.460061 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.460062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:09.460112 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:09.464696 (+ 4584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:09.464707 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:09.466722 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
W20260811 11:06:09.466957 10647 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:09.457798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:46461 (local address 127.25.227.62:45677)
0811 11:06:09.457953 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:09.457955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:09.457996 (+ 41us) server_negotiation.cc:407] Connection header received
0811 11:06:09.458061 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:09.458061 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:09.458074 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:09.458132 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:09.458478 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.459063 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.459788 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.459975 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.460026 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:09.466847 (+ 6821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:46461: BlockingRecv error: recv got EOF from 127.25.227.1:46461 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
Aug 11 11:06:09 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:09 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:09.594877 10651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:09.589908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:59197)
0811 11:06:09.590099 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:09.590110 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:09.590169 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:09.590318 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:09.590319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:09.590504 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:09.590556 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:09.590557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.591205 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.591206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:09.591786 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:09.591788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.592200 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.592202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:09.592253 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:09.592808 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:09.592814 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:09.594771 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":107,"threads_started":1}
W20260811 11:06:09.594923 10647 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:09.589993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:59197 (local address 127.25.227.62:45677)
0811 11:06:09.590057 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:09.590059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:09.590154 (+ 95us) server_negotiation.cc:407] Connection header received
0811 11:06:09.590247 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:09.590248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:09.590258 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:09.590306 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:09.590612 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.591104 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.591863 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.592056 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.592109 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:09.594857 (+ 2748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:59197: BlockingRecv error: recv got EOF from 127.25.227.2:59197 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 11:06:09 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:09 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:09.743667 10652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:09.738773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:35117)
0811 11:06:09.739066 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:09.739087 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:09.739157 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:09.739294 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:09.739294 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:09.739474 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:09.739525 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:09.739527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.740284 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.740286 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:09.740835 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:09.740837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.741160 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.741160 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:09.741285 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:09.741743 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:09.741748 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:09.743582 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":100,"threads_started":1}
W20260811 11:06:09.743736 10647 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:09.738871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35117 (local address 127.25.227.62:45677)
0811 11:06:09.739081 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:09.739083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:09.739139 (+ 56us) server_negotiation.cc:407] Connection header received
0811 11:06:09.739203 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:09.739204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:09.739216 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:09.739275 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:09.739594 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.740202 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.740911 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:09.741090 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:09.741146 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:09.743685 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:35117: BlockingRecv error: recv got EOF from 127.25.227.3:35117 (error 108)
Metrics: {"server-negotiator.queue_time_us":182}
Aug 11 11:06:10 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:10 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:10.472932 10653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:10.467610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:50279)
0811 11:06:10.467766 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:10.467777 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:10.467829 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:10.467975 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:10.467975 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:10.468160 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:10.468207 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:10.468208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.468956 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.468957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:10.469634 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:10.469644 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.470120 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.470121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:10.470173 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:10.470828 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:10.470833 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:10.472859 (+ 2026us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
W20260811 11:06:10.473094 10654 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:10.467680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:50279 (local address 127.25.227.62:45677)
0811 11:06:10.467827 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:10.467829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:10.467840 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:06:10.467876 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:10.467877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:10.467887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:10.467952 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:10.468289 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.468868 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.469772 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.470026 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.470093 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:10.472990 (+ 2897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:50279: BlockingRecv error: recv got EOF from 127.25.227.1:50279 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
Aug 11 11:06:10 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:10 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:10.600273 10657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:10.595415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:35547)
0811 11:06:10.595574 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:10.595587 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:10.595692 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:10.595906 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:10.595907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:10.596145 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:10.596207 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:10.596210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.596878 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.596879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:10.597465 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:10.597467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.597807 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.597808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:10.597850 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:10.598322 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:10.598327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:10.600178 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
W20260811 11:06:10.600345 10654 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:10.595541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:35547 (local address 127.25.227.62:45677)
0811 11:06:10.595614 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:10.595616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:10.595656 (+ 40us) server_negotiation.cc:407] Connection header received
0811 11:06:10.595799 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:10.595800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:10.595815 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:10.595876 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:10.596310 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.596807 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.597538 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.597739 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.597795 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:10.600296 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:35547: BlockingRecv error: recv got EOF from 127.25.227.2:35547 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 11:06:10 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:10 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:10.749338 10659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:10.744217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:37181)
0811 11:06:10.744423 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:10.744436 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:10.744532 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:10.744698 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:10.744700 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:10.744930 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:10.744978 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:10.744980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.745908 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.745909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:10.746460 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:10.746462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.746859 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.746860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:10.746923 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:10.747388 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:10.747393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:10.749267 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":118,"threads_started":1}
W20260811 11:06:10.749464 10654 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:10.744324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:37181 (local address 127.25.227.62:45677)
0811 11:06:10.744411 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:10.744413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:10.744512 (+ 99us) server_negotiation.cc:407] Connection header received
0811 11:06:10.744602 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:10.744604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:10.744619 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:10.744690 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:10.745073 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.745842 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.746553 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:10.746765 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:10.746855 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:10.749361 (+ 2506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:37181: BlockingRecv error: recv got EOF from 127.25.227.3:37181 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 11:06:11 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:11 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:11.478250 10660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:11.473467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:35207)
0811 11:06:11.473644 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:11.473657 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:11.473713 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:11.473870 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:11.473870 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:11.474055 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:11.474104 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:11.474105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.474787 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.474788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:11.475336 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:11.475338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.475672 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.475673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:11.475717 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:11.476196 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:11.476201 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:11.478188 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
W20260811 11:06:11.478367 10661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:11.473579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:35207 (local address 127.25.227.62:45677)
0811 11:06:11.473742 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:11.473743 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:11.473752 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:06:11.473778 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:11.473778 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:11.473789 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:11.473849 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:11.474173 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.474690 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.475413 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.475606 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.475658 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:11.478293 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:35207: BlockingRecv error: recv got EOF from 127.25.227.1:35207 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
Aug 11 11:06:11 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:11 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:11.605749 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:11.600769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:43005)
0811 11:06:11.600973 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:11.600987 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:11.601060 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:11.601260 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:11.601261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:11.601460 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:11.601508 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:11.601510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.602242 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.602244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:11.602793 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:11.602795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.603167 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.603168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:11.603238 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:11.603753 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:11.603758 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:11.605649 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":114,"threads_started":1}
W20260811 11:06:11.605809 10661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:11.600928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43005 (local address 127.25.227.62:45677)
0811 11:06:11.601003 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:11.601006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:11.601040 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:06:11.601140 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:11.601141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:11.601155 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:11.601251 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:11.601597 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.602130 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.602886 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.603089 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.603166 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:11.605743 (+ 2577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:43005: BlockingRecv error: recv got EOF from 127.25.227.2:43005 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 11:06:11 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:11 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:11.754626 10665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:11.749807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:54087)
0811 11:06:11.750006 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:11.750018 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:11.750087 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:11.750247 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:11.750248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:11.750457 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:11.750503 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:11.750505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.751165 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.751166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:11.751710 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:11.751712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.752099 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.752100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:11.752161 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:11.752641 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:11.752647 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:11.754565 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":121,"threads_started":1}
W20260811 11:06:11.754770 10661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:11.749902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:54087 (local address 127.25.227.62:45677)
0811 11:06:11.749987 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:11.749989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:11.750066 (+ 77us) server_negotiation.cc:407] Connection header received
0811 11:06:11.750149 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:11.750150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:11.750167 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:11.750237 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:11.750586 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.751082 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.751826 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:11.752022 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:11.752099 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:11.754680 (+ 2581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:54087: BlockingRecv error: recv got EOF from 127.25.227.3:54087 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 11:06:12 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:12 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:12.483846 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:12.478900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:50393)
0811 11:06:12.479075 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:12.479086 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:12.479146 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:12.479285 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:12.479286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:12.479467 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:12.479517 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:12.479518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.480168 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.480169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:12.480717 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:12.480719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.481041 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.481042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:12.481084 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:12.481687 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:12.481692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:12.483757 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":100,"threads_started":1}
W20260811 11:06:12.483982 10667 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:12.478999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:50393 (local address 127.25.227.62:45677)
0811 11:06:12.479111 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:12.479114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:12.479126 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:06:12.479194 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:12.479195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:12.479206 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:12.479264 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:12.479585 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.480092 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.480794 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.480974 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.481023 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:12.483870 (+ 2847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:50393: BlockingRecv error: recv got EOF from 127.25.227.1:50393 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":52,"threads_started":1}
Aug 11 11:06:12 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:12 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:12.610989 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:12.606332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:43201)
0811 11:06:12.606518 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:12.606537 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:12.606600 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:12.606712 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:12.606712 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:12.606906 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:12.606955 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:12.606957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.607582 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.607583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:12.608106 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:12.608108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.608431 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.608432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:12.608472 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:12.609003 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:12.609009 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:12.610930 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":65,"threads_started":1}
W20260811 11:06:12.611132 10667 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:12.606468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43201 (local address 127.25.227.62:45677)
0811 11:06:12.606537 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:12.606539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:12.606585 (+ 46us) server_negotiation.cc:407] Connection header received
0811 11:06:12.606654 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:12.606655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:12.606667 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:12.606706 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:12.607015 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.607515 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.608177 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.608367 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.608417 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:12.611022 (+ 2605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:43201: BlockingRecv error: recv got EOF from 127.25.227.2:43201 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 11:06:12 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:12 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:12.759964 10672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:12.755114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:37891)
0811 11:06:12.755281 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:12.755292 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:12.755370 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:12.755545 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:12.755546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:12.755743 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:12.755792 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:12.755794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.756485 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.756486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:12.757044 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:12.757046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.757464 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.757465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:12.757529 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:12.757959 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:12.757964 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:12.759895 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":96,"threads_started":1}
W20260811 11:06:12.760077 10667 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:12.755163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:37891 (local address 127.25.227.62:45677)
0811 11:06:12.755229 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:12.755232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:12.755350 (+ 118us) server_negotiation.cc:407] Connection header received
0811 11:06:12.755452 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:12.755453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:12.755467 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:12.755536 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:12.755874 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.756401 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.757147 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:12.757378 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:12.757453 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:12.759998 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:37891: BlockingRecv error: recv got EOF from 127.25.227.3:37891 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 11:06:13 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:13 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:13.489405 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:13.484350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:46351)
0811 11:06:13.484514 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:13.484526 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:13.484582 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:13.484724 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:13.484725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:13.484913 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:13.484969 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:13.484971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.485613 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.485615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:13.486157 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:13.486158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.486513 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.486515 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:13.486555 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:13.487135 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:13.487141 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:13.489344 (+ 2203us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
W20260811 11:06:13.489604 10674 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:13.484424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:46351 (local address 127.25.227.62:45677)
0811 11:06:13.484572 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:13.484574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:13.484584 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:06:13.484642 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:13.484643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:13.484654 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:13.484708 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:13.485036 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.485556 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.486248 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.486448 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.486503 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:13.489524 (+ 3021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:46351: BlockingRecv error: recv got EOF from 127.25.227.1:46351 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
Aug 11 11:06:13 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:13 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:13.616411 10675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:13.611494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:33985)
0811 11:06:13.611655 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:13.611667 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:13.611732 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:13.611868 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:13.611869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:13.612049 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:13.612098 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:13.612100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.612818 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.612819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:13.613437 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:13.613440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.613801 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.613803 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:13.613854 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:13.614412 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:13.614417 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:13.616298 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
W20260811 11:06:13.616449 10674 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:13.611574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:33985 (local address 127.25.227.62:45677)
0811 11:06:13.611652 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:13.611654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:13.611731 (+ 77us) server_negotiation.cc:407] Connection header received
0811 11:06:13.611795 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:13.611796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:13.611806 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:13.611849 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:13.612208 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.612732 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.613520 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.613708 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.613766 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:13.616381 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:33985: BlockingRecv error: recv got EOF from 127.25.227.2:33985 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 11:06:13 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:13 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.3@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:13.765159 10678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:13.760470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.3:58293)
0811 11:06:13.760634 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:13.760650 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:13.760709 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:13.760868 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:13.760869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:13.761039 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:13.761090 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:13.761092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.761742 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.761743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:13.762288 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:13.762289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.762600 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.762601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:13.762641 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:13.763169 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:13.763175 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:13.765096 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
W20260811 11:06:13.765385 10674 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:13.760525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:58293 (local address 127.25.227.62:45677)
0811 11:06:13.760588 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:13.760590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:13.760703 (+ 113us) server_negotiation.cc:407] Connection header received
0811 11:06:13.760790 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:13.760790 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:13.760804 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:13.760847 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:13.761147 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.761675 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.762357 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:13.762535 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:13.762587 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:13.765315 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.3:58293: BlockingRecv error: recv got EOF from 127.25.227.3:58293 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 11:06:14 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:14 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.1@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:14.501374 10679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:14.489940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.1:34179)
0811 11:06:14.490086 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:14.490098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:14.490154 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:14.490288 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:14.490289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:14.490481 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:14.490531 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:14.490533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.491172 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.491173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:14.491729 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:14.491730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.492092 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.492093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:14.492145 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:14.499361 (+ 7216us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:14.499366 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:14.501310 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
W20260811 11:06:14.501502 10682 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:14.490014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:34179 (local address 127.25.227.62:45677)
0811 11:06:14.490162 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:14.490164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:14.490171 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:06:14.490194 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:14.490194 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:14.490205 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:14.490283 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:14.490596 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.491100 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.491806 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.492002 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.492058 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:14.501414 (+ 9356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.1:34179: BlockingRecv error: recv got EOF from 127.25.227.1:34179 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
Aug 11 11:06:14 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 11:06:14 dist-test-slave-z8x9 krb5kdc[8602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.25.227.2@KRBTEST.COM for oryx/127.25.227.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 11:06:14.621369 10684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:14.616987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45677 (local address 127.25.227.2:43737)
0811 11:06:14.617154 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:14.617181 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:14.617241 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:14.617377 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:14.617378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:14.617549 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:14.617598 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:14.617600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.618207 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.618208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:14.618739 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:14.618740 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.619050 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.619051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:14.619090 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:14.619520 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:14.619524 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:14.621311 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.25.227.62:45677: Server oryx/127.25.227.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
W20260811 11:06:14.621490 10682 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:14.617036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43737 (local address 127.25.227.62:45677)
0811 11:06:14.617105 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:14.617107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:14.617240 (+ 133us) server_negotiation.cc:407] Connection header received
0811 11:06:14.617309 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:14.617310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:14.617321 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:14.617371 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:14.617653 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.618141 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.618808 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.618989 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.619039 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:14.621412 (+ 2373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.25.227.2:43737: BlockingRecv error: recv got EOF from 127.25.227.2:43737 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:06:14.690104 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 9706
I20260811 11:06:14.712152 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 10010
I20260811 11:06:14.721041 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 10288
I20260811 11:06:14.751578 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 9568
2026-08-11T11:06:14Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17825 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T11:06:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:06:14Z Disabled control of system clock
I20260811 11:06:14.788045 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:39669
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:39669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 11:06:14.872008 10690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:14.872215 10690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:14.872234 10690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:14.873456 10690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:06:14.873497 10690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:14.873510 10690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:14.873522 10690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:06:14.873535 10690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:06:14.874784 10690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:39669
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:39669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:14.874985 10690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:14.875221 10690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:14.880167 10702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:14.880208 10698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:14.880173 10696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:14.880450 10690 server_base.cc:1034] running on GCE node
I20260811 11:06:14.880784 10690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:14.881070 10690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:14.882210 10690 hybrid_clock.cc:648] HybridClock initialized: now 1786446374882206 us; error 37 us; skew 500 ppm
I20260811 11:06:14.883483 10690 webserver.cc:460] Webserver started at http://127.25.227.62:40097/ using document root <none> and password file <none>
I20260811 11:06:14.883718 10690 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:14.883764 10690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:14.883910 10690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:14.884961 10690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "0b8eb3c26fb54e1cabbe2e4892229b42"
format_stamp: "Formatted at 2026-08-11 11:06:14 on dist-test-slave-z8x9"
server_key: "a5d527bc1d67396422ce83ecad28d7db"
server_key_iv: "d85a6c2acdc0eb068463660a86937576"
server_key_version: "encryptionkey@0"
I20260811 11:06:14.885367 10690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "0b8eb3c26fb54e1cabbe2e4892229b42"
format_stamp: "Formatted at 2026-08-11 11:06:14 on dist-test-slave-z8x9"
server_key: "a5d527bc1d67396422ce83ecad28d7db"
server_key_iv: "d85a6c2acdc0eb068463660a86937576"
server_key_version: "encryptionkey@0"
I20260811 11:06:14.886686 10690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:14.887395 10709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:14.887682 10690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:14.887776 10690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "0b8eb3c26fb54e1cabbe2e4892229b42"
format_stamp: "Formatted at 2026-08-11 11:06:14 on dist-test-slave-z8x9"
server_key: "a5d527bc1d67396422ce83ecad28d7db"
server_key_iv: "d85a6c2acdc0eb068463660a86937576"
server_key_version: "encryptionkey@0"
I20260811 11:06:14.887851 10690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:14.899890 10690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:14.900182 10690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:14.900342 10690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:14.904542 10690 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:39669
I20260811 11:06:14.904603 10813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:39669 every 8 connection(s)
I20260811 11:06:14.904937 10690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:06:14.905627 10814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:06:14.908226 10814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42: Bootstrap starting.
I20260811 11:06:14.908839 10814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42: Neither blocks nor log segments found. Creating new log.
I20260811 11:06:14.909142 10814 log.cc:824] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42: Log is configured to *not* fsync() on all Append() calls
I20260811 11:06:14.909842 10814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42: No bootstrap required, opened a new log
I20260811 11:06:14.911404 10814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39669 } }
I20260811 11:06:14.911540 10814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:06:14.911597 10814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b8eb3c26fb54e1cabbe2e4892229b42, State: Initialized, Role: FOLLOWER
I20260811 11:06:14.911768 10814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39669 } }
I20260811 11:06:14.911852 10814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:06:14.911907 10814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:06:14.911957 10814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:06:14.912523 10814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39669 } }
I20260811 11:06:14.912634 10814 leader_election.cc:302] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b8eb3c26fb54e1cabbe2e4892229b42; no voters:
I20260811 11:06:14.912820 10814 leader_election.cc:288] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:06:14.912855 10818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:06:14.913030 10818 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [term 1 LEADER]: Becoming Leader. State: Replica: 0b8eb3c26fb54e1cabbe2e4892229b42, State: Running, Role: LEADER
I20260811 11:06:14.913085 10814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:06:14.913156 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 10690
I20260811 11:06:14.913203 10818 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39669 } }
I20260811 11:06:14.913283 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:06:14.913528 26508 external_mini_cluster.cc:1428] Setting key 8fff0d96374d134e08e4a9c68702fdf1
I20260811 11:06:14.913564 10818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b8eb3c26fb54e1cabbe2e4892229b42. Latest consensus state: current_term: 1 leader_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39669 } } }
I20260811 11:06:14.913630 10818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [sys.catalog]: This master's current role is: LEADER
I20260811 11:06:14.914215 10824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8eb3c26fb54e1cabbe2e4892229b42" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39669 } } }
I20260811 11:06:14.914299 10824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42 [sys.catalog]: This master's current role is: LEADER
I20260811 11:06:14.914958 10832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:06:14.915716 10832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:06:14.917351 10832 catalog_manager.cc:1347] Generated new cluster ID: fcf89d118b5a4944ba701e9ee3dd39a6
I20260811 11:06:14.917408 10832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:06:14.920419 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:14.914884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44144 (local address 127.25.227.62:39669)
0811 11:06:14.915120 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:14.915129 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:14.915163 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:06:14.915303 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:14.915311 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:14.915392 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:14.915508 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:14.915769 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.916841 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.917935 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:14.918565 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:14.918666 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:14.919580 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:14.919584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:14.919584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:14.919779 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:14.919818 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:14.919831 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:14.919883 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:14.920132 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 11:06:14.920206 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":66,"threads_started":1}
I20260811 11:06:14.927151 10832 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:06:14.927831 10832 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:06:14.936434 10832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b8eb3c26fb54e1cabbe2e4892229b42: Generated new TSK 0
I20260811 11:06:14.936631 10832 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:06:14.941951 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39669
--builtin_ntp_servers=127.25.227.20:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 11:06:15.026479 10857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.026697 10857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.026719 10857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.028002 10857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.028047 10857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.028074 10857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:06:15.029461 10857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.029731 10857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.030054 10857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.036245 10870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.036267 10872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.036490 10857 server_base.cc:1034] running on GCE node
W20260811 11:06:15.036288 10869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.036798 10857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.037047 10857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.038230 10857 hybrid_clock.cc:648] HybridClock initialized: now 1786446375038226 us; error 48 us; skew 500 ppm
I20260811 11:06:15.039505 10857 webserver.cc:460] Webserver started at http://127.25.227.1:32877/ using document root <none> and password file <none>
I20260811 11:06:15.039752 10857 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.039822 10857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.039968 10857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.041045 10857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "94d2b582bb3248ed81c9388e0f7721bc"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "2a3b4452f79442afd0e4da99156230e1"
server_key_iv: "c39971d64d6649550efa2d330268e14c"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.041463 10857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "94d2b582bb3248ed81c9388e0f7721bc"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "2a3b4452f79442afd0e4da99156230e1"
server_key_iv: "c39971d64d6649550efa2d330268e14c"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.042918 10857 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:06:15.043702 10882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.043869 10857 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:06:15.043967 10857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "94d2b582bb3248ed81c9388e0f7721bc"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "2a3b4452f79442afd0e4da99156230e1"
server_key_iv: "c39971d64d6649550efa2d330268e14c"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.044044 10857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.060995 10857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.061348 10857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.061496 10857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.061710 10857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:15.062049 10857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:15.062109 10857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.062152 10857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:15.062179 10857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.067968 10857 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:38401
I20260811 11:06:15.068086 11094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:38401 every 8 connection(s)
I20260811 11:06:15.068375 10857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:06:15.073654 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.069088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:46279 (local address 127.25.227.62:39669)
0811 11:06:15.069148 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.069151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.069441 (+ 290us) server_negotiation.cc:407] Connection header received
0811 11:06:15.069988 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.069989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.070005 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.070059 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.070723 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.071232 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.072208 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.072421 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.072497 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:15.073317 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.073319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.073319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.073324 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.073340 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.073344 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.073408 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.073524 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.073562 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:06:15.073915 11099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.069084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39669 (local address 127.25.227.1:46279)
0811 11:06:15.069325 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:15.069360 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:15.069883 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:15.070132 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:15.070136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:15.070146 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:15.070632 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:15.070636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.071343 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.071344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:15.072116 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:15.072118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.072511 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.072512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:15.072640 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:15.073131 (+ 491us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:06:15.073131 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:15.073157 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:06:15.073219 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:15.073409 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:15.073416 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:15.073419 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:06:15.073525 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:06:15.073662 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":131,"threads_started":1}
I20260811 11:06:15.074398 11095 heartbeater.cc:347] Connected to a master server at 127.25.227.62:39669
I20260811 11:06:15.074496 11095 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:15.074676 11095 heartbeater.cc:511] Master 127.25.227.62:39669 requested a full tablet report, sending...
I20260811 11:06:15.075176 10753 ts_manager.cc:194] Registered new tserver with Master: 94d2b582bb3248ed81c9388e0f7721bc (127.25.227.1:38401)
I20260811 11:06:15.075781 10753 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.1:46279
I20260811 11:06:15.078305 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 10857
I20260811 11:06:15.078398 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:06:15.078601 26508 external_mini_cluster.cc:1428] Setting key 00116e78ddbe6885facef0b33f481acb
I20260811 11:06:15.079493 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39669
--builtin_ntp_servers=127.25.227.20:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 11:06:15.164211 11100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.164464 11100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.164502 11100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.165724 11100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.165789 11100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.165830 11100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:06:15.167202 11100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.167490 11100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.167811 11100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.173151 11112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.173231 11118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.173298 11114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.173445 11100 server_base.cc:1034] running on GCE node
I20260811 11:06:15.173655 11100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.173918 11100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.175071 11100 hybrid_clock.cc:648] HybridClock initialized: now 1786446375175071 us; error 43 us; skew 500 ppm
I20260811 11:06:15.176409 11100 webserver.cc:460] Webserver started at http://127.25.227.2:38231/ using document root <none> and password file <none>
I20260811 11:06:15.176679 11100 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.176980 11100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.177227 11100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.178397 11100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "f6351acfdd034707953bf45031b6a032"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "bbabb26c8ccd79084831411920a831c8"
server_key_iv: "65347e022be9509dfe357f68503adc4a"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.178807 11100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "f6351acfdd034707953bf45031b6a032"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "bbabb26c8ccd79084831411920a831c8"
server_key_iv: "65347e022be9509dfe357f68503adc4a"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.180177 11100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:06:15.180868 11125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.181053 11100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:06:15.181159 11100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "f6351acfdd034707953bf45031b6a032"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "bbabb26c8ccd79084831411920a831c8"
server_key_iv: "65347e022be9509dfe357f68503adc4a"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.181288 11100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.204527 11100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.204908 11100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.205071 11100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.205417 11100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:15.205787 11100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:15.205850 11100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.205896 11100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:15.205927 11100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.211555 11100 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:38347
I20260811 11:06:15.211601 11352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:38347 every 8 connection(s)
I20260811 11:06:15.211980 11100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:06:15.215194 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 11100
I20260811 11:06:15.215297 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:06:15.215482 26508 external_mini_cluster.cc:1428] Setting key 91819846a6e75322621b6b330a821be2
I20260811 11:06:15.216400 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39669
--builtin_ntp_servers=127.25.227.20:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 11:06:15.217873 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.212746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:56763 (local address 127.25.227.62:39669)
0811 11:06:15.212810 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.212813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.213051 (+ 238us) server_negotiation.cc:407] Connection header received
0811 11:06:15.213773 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.213775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.213790 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.213849 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.214608 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.215104 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.216305 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.216531 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.216596 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:15.217559 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.217560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.217561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.217566 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.217586 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.217591 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.217658 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.217721 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.217754 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:06:15.217976 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.212744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39669 (local address 127.25.227.2:56763)
0811 11:06:15.212926 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:15.212960 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:15.213657 (+ 697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:15.213920 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:15.213926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:15.213936 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:15.214505 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:15.214511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.215207 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.215208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:15.216220 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:15.216224 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.216676 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.216677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:15.216791 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:15.217415 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:06:15.217416 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:15.217445 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:06:15.217468 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:15.217659 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:15.217661 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:15.217663 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:06:15.217711 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 11:06:15.217790 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260811 11:06:15.218472 11356 heartbeater.cc:347] Connected to a master server at 127.25.227.62:39669
I20260811 11:06:15.218565 11356 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:15.218765 11356 heartbeater.cc:511] Master 127.25.227.62:39669 requested a full tablet report, sending...
I20260811 11:06:15.219138 10753 ts_manager.cc:194] Registered new tserver with Master: f6351acfdd034707953bf45031b6a032 (127.25.227.2:38347)
I20260811 11:06:15.219513 10753 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.2:56763
W20260811 11:06:15.319607 11361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.319813 11361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.319834 11361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.320993 11361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.321036 11361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.321084 11361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:06:15.322503 11361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:39669
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.322752 11361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.323043 11361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.328176 11384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.328301 11377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.328377 11361 server_base.cc:1034] running on GCE node
W20260811 11:06:15.328287 11379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.328697 11361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.328907 11361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.330087 11361 hybrid_clock.cc:648] HybridClock initialized: now 1786446375330069 us; error 41 us; skew 500 ppm
I20260811 11:06:15.331357 11361 webserver.cc:460] Webserver started at http://127.25.227.3:36189/ using document root <none> and password file <none>
I20260811 11:06:15.331596 11361 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.331661 11361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.331816 11361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.332893 11361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "a7680570e6aa4faa9cd20f91b399113a"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "df72dde302355032777b50766a7c418d"
server_key_iv: "21ba1cf06870c5be86846d7a1f6c7991"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.333324 11361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "a7680570e6aa4faa9cd20f91b399113a"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "df72dde302355032777b50766a7c418d"
server_key_iv: "21ba1cf06870c5be86846d7a1f6c7991"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.334649 11361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:15.335392 11394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.335570 11361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:06:15.335670 11361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "a7680570e6aa4faa9cd20f91b399113a"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "df72dde302355032777b50766a7c418d"
server_key_iv: "21ba1cf06870c5be86846d7a1f6c7991"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.335752 11361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.344487 11361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.344772 11361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.344913 11361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.345131 11361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:15.345476 11361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:15.345531 11361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.345571 11361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:15.345599 11361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.352290 11361 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:37459
I20260811 11:06:15.352327 11601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:37459 every 8 connection(s)
I20260811 11:06:15.352670 11361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:06:15.354467 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 11361
I20260811 11:06:15.354568 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:06:15.354796 26508 external_mini_cluster.cc:1428] Setting key f558f7c9281f7a185d517a5c40566ba7
I20260811 11:06:15.358309 10853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.353418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35255 (local address 127.25.227.62:39669)
0811 11:06:15.353504 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.353507 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.353724 (+ 217us) server_negotiation.cc:407] Connection header received
0811 11:06:15.354212 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.354214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.354224 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.354280 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.355230 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.355956 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.356913 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.357110 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.357309 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:15.358105 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.358106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.358106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.358110 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.358121 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.358125 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.358166 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.358216 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.358238 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:06:15.358486 11604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.353387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39669 (local address 127.25.227.3:35255)
0811 11:06:15.353607 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:15.353642 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:15.354131 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:15.354356 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:15.354360 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:15.354371 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:15.355129 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:15.355136 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.356035 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.356036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:15.356809 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:15.356811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:15.357301 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:15.357302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:15.357414 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:15.357982 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:06:15.357983 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:15.358012 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:06:15.358034 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:15.358166 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:15.358168 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:15.358170 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:06:15.358210 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 11:06:15.358289 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
I20260811 11:06:15.358958 11602 heartbeater.cc:347] Connected to a master server at 127.25.227.62:39669
I20260811 11:06:15.359050 11602 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:15.359197 11602 heartbeater.cc:511] Master 127.25.227.62:39669 requested a full tablet report, sending...
I20260811 11:06:15.359522 10753 ts_manager.cc:194] Registered new tserver with Master: a7680570e6aa4faa9cd20f91b399113a (127.25.227.3:37459)
I20260811 11:06:15.359850 10753 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.3:35255
I20260811 11:06:15.366489 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 11:06:15.368254 10853 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:15.367793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44148 (local address 127.25.227.62:39669)
0811 11:06:15.367849 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.367850 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.367972 (+ 122us) server_negotiation.cc:407] Connection header received
0811 11:06:15.368025 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.368026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.368037 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.368079 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.368173 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44148: BlockingRecv error: recv got EOF from 127.0.0.1:44148 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:06:15.368342 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 10857
I20260811 11:06:15.387403 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 11100
I20260811 11:06:15.396703 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 11361
I20260811 11:06:15.416465 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 10690
2026-08-11T11:06:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (663 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T11:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:06:15Z Disabled control of system clock
I20260811 11:06:15.450558 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42071
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:37521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:42071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:06:15.534276 11619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.534493 11619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.534515 11619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.535647 11619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:06:15.535697 11619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.535710 11619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.535722 11619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:06:15.535735 11619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:06:15.536998 11619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:42071
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.537261 11619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.537514 11619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.542415 11630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.542627 11619 server_base.cc:1034] running on GCE node
W20260811 11:06:15.542428 11625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.542415 11626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.543002 11619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.543340 11619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.544509 11619 hybrid_clock.cc:648] HybridClock initialized: now 1786446375544493 us; error 43 us; skew 500 ppm
I20260811 11:06:15.545775 11619 webserver.cc:460] Webserver started at http://127.25.227.62:41633/ using document root <none> and password file <none>
I20260811 11:06:15.546013 11619 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.546082 11619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.546231 11619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.547349 11619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "c918ac2e220343868cfa6cb47ecacc45"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "337613e070d34cd7fd3110a91f7d2860"
server_key_iv: "b45212c2d12be8d2fb0da4bdbe41cd19"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.547719 11619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "c918ac2e220343868cfa6cb47ecacc45"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "337613e070d34cd7fd3110a91f7d2860"
server_key_iv: "b45212c2d12be8d2fb0da4bdbe41cd19"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.549005 11619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:06:15.549782 11644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.549959 11619 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.550060 11619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "c918ac2e220343868cfa6cb47ecacc45"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "337613e070d34cd7fd3110a91f7d2860"
server_key_iv: "b45212c2d12be8d2fb0da4bdbe41cd19"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.550140 11619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.553535 11619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.553786 11619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.553925 11619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.557813 11619 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:42071
I20260811 11:06:15.557848 11730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:42071 every 8 connection(s)
I20260811 11:06:15.558162 11619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:06:15.558849 11733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:06:15.561678 11733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45: Bootstrap starting.
I20260811 11:06:15.562273 11733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45: Neither blocks nor log segments found. Creating new log.
I20260811 11:06:15.562582 11733 log.cc:824] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45: Log is configured to *not* fsync() on all Append() calls
I20260811 11:06:15.563271 11733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45: No bootstrap required, opened a new log
I20260811 11:06:15.564924 11733 raft_consensus.cc:348] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c918ac2e220343868cfa6cb47ecacc45" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42071 } }
I20260811 11:06:15.565109 11733 raft_consensus.cc:374] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:06:15.565160 11733 raft_consensus.cc:729] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c918ac2e220343868cfa6cb47ecacc45, State: Initialized, Role: FOLLOWER
I20260811 11:06:15.565238 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 11619
I20260811 11:06:15.565344 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:06:15.565397 11733 consensus_queue.cc:260] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c918ac2e220343868cfa6cb47ecacc45" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42071 } }
I20260811 11:06:15.565492 11733 raft_consensus.cc:388] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:06:15.565531 11733 raft_consensus.cc:482] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:06:15.565559 26508 external_mini_cluster.cc:1428] Setting key 195c39ca5af966fdd71b3a833557024a
I20260811 11:06:15.565582 11733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:06:15.566329 11733 raft_consensus.cc:504] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c918ac2e220343868cfa6cb47ecacc45" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42071 } }
I20260811 11:06:15.566439 11733 leader_election.cc:302] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c918ac2e220343868cfa6cb47ecacc45; no voters:
I20260811 11:06:15.566627 11733 leader_election.cc:288] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:06:15.566900 11746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:06:15.566915 11733 sys_catalog.cc:564] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:06:15.567106 11746 raft_consensus.cc:686] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [term 1 LEADER]: Becoming Leader. State: Replica: c918ac2e220343868cfa6cb47ecacc45, State: Running, Role: LEADER
I20260811 11:06:15.567389 11746 consensus_queue.cc:237] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c918ac2e220343868cfa6cb47ecacc45" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42071 } }
I20260811 11:06:15.567878 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.566069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.25.227.62:42071)
0811 11:06:15.566299 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.566306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.566332 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:06:15.566450 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.566457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.566502 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.566629 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.567350 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.567354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.567354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.567358 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.567406 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.567419 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.567492 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.567585 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.567648 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260811 11:06:15.567906 11747 sys_catalog.cc:455] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c918ac2e220343868cfa6cb47ecacc45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c918ac2e220343868cfa6cb47ecacc45" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42071 } } }
I20260811 11:06:15.567981 11747 sys_catalog.cc:458] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [sys.catalog]: This master's current role is: LEADER
I20260811 11:06:15.568336 11748 sys_catalog.cc:455] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c918ac2e220343868cfa6cb47ecacc45. Latest consensus state: current_term: 1 leader_uuid: "c918ac2e220343868cfa6cb47ecacc45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c918ac2e220343868cfa6cb47ecacc45" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42071 } } }
I20260811 11:06:15.568414 11748 sys_catalog.cc:458] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45 [sys.catalog]: This master's current role is: LEADER
W20260811 11:06:15.569067 11783 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:06:15.569125 11783 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:06:15.569352 11766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:06:15.569522 11766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:06:15.571050 11766 catalog_manager.cc:1347] Generated new cluster ID: 85b35c6960da4533af4816c7e1fa432f
I20260811 11:06:15.571110 11766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:06:15.594652 11766 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:06:15.594852 11766 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:06:15.606442 11766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c918ac2e220343868cfa6cb47ecacc45: Generated new TSK 0
I20260811 11:06:15.606642 11766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:06:15.617445 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:42071
--builtin_ntp_servers=127.25.227.20:37521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:06:15.721304 11788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.721514 11788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.721537 11788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.722710 11788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.722752 11788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.722777 11788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:06:15.724118 11788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:42071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.724385 11788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.724690 11788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.729969 11800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.729998 11802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.729969 11804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.730257 11788 server_base.cc:1034] running on GCE node
I20260811 11:06:15.730489 11788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.730733 11788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.731910 11788 hybrid_clock.cc:648] HybridClock initialized: now 1786446375731887 us; error 41 us; skew 500 ppm
I20260811 11:06:15.733294 11788 webserver.cc:460] Webserver started at http://127.25.227.1:46803/ using document root <none> and password file <none>
I20260811 11:06:15.733556 11788 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.733649 11788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.733824 11788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.734935 11788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "cd11955d501a4f2e99160b9cd1485790"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "a3814849c5f59db95a43176967cfc615"
server_key_iv: "9049aae059238b95fc4f7a61d5ee5b2b"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.735291 11788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "cd11955d501a4f2e99160b9cd1485790"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "a3814849c5f59db95a43176967cfc615"
server_key_iv: "9049aae059238b95fc4f7a61d5ee5b2b"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.736668 11788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:06:15.737455 11821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.737629 11788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:06:15.737733 11788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "cd11955d501a4f2e99160b9cd1485790"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "a3814849c5f59db95a43176967cfc615"
server_key_iv: "9049aae059238b95fc4f7a61d5ee5b2b"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.737809 11788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.741094 11788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.741369 11788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.741519 11788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.741724 11788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:15.742046 11788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:15.742100 11788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.742139 11788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:15.742166 11788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.747931 11788 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:45283
I20260811 11:06:15.748039 12037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:45283 every 8 connection(s)
I20260811 11:06:15.748325 11788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:06:15.751294 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.749062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:45503 (local address 127.25.227.62:42071)
0811 11:06:15.749107 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.749109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.749395 (+ 286us) server_negotiation.cc:407] Connection header received
0811 11:06:15.749845 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.749847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.749854 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.749908 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.751112 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.751113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.751113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.751117 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.751129 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.751133 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.751174 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.751221 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.751234 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:06:15.751519 12045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.749051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:42071 (local address 127.25.227.1:45503)
0811 11:06:15.749278 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:15.749312 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:15.749760 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:15.749963 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:15.749966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:15.749975 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:15.750982 (+ 1007us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:06:15.750983 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:15.751012 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:06:15.751042 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:15.751174 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:15.751176 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:15.751179 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:06:15.751230 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:06:15.751283 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260811 11:06:15.752146 12039 heartbeater.cc:347] Connected to a master server at 127.25.227.62:42071
I20260811 11:06:15.752256 12039 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:15.752429 12039 heartbeater.cc:511] Master 127.25.227.62:42071 requested a full tablet report, sending...
I20260811 11:06:15.752951 11666 ts_manager.cc:194] Registered new tserver with Master: cd11955d501a4f2e99160b9cd1485790 (127.25.227.1:45283)
I20260811 11:06:15.754057 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 11788
I20260811 11:06:15.754158 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:06:15.754351 26508 external_mini_cluster.cc:1428] Setting key 89ab6263efdfb79370693d434de5ec3f
I20260811 11:06:15.755162 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:42071
--builtin_ntp_servers=127.25.227.20:37521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:06:15.839233 12046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.839434 12046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.839457 12046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.840739 12046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.840785 12046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.840811 12046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:06:15.842243 12046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:42071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.842499 12046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.842798 12046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.847841 12053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.847935 12057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.847940 12054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.848277 12046 server_base.cc:1034] running on GCE node
I20260811 11:06:15.848506 12046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.848711 12046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.849880 12046 hybrid_clock.cc:648] HybridClock initialized: now 1786446375849865 us; error 32 us; skew 500 ppm
I20260811 11:06:15.851233 12046 webserver.cc:460] Webserver started at http://127.25.227.2:38899/ using document root <none> and password file <none>
I20260811 11:06:15.851500 12046 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.851548 12046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.851712 12046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.852860 12046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "1fa237757faf445ba5b5ae2d25bfb29c"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "b0ff1310543d2af6e70123ce2f5ec3d9"
server_key_iv: "925c9603ed238087b83185c2c27d2bfe"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.853281 12046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "1fa237757faf445ba5b5ae2d25bfb29c"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "b0ff1310543d2af6e70123ce2f5ec3d9"
server_key_iv: "925c9603ed238087b83185c2c27d2bfe"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.854612 12046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:15.855397 12071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.855581 12046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:15.855672 12046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "1fa237757faf445ba5b5ae2d25bfb29c"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "b0ff1310543d2af6e70123ce2f5ec3d9"
server_key_iv: "925c9603ed238087b83185c2c27d2bfe"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.855746 12046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.859222 12046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.859483 12046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.859613 12046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.859826 12046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:15.860132 12046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:15.860165 12046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.860203 12046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:15.860231 12046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.865870 12046 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:41241
I20260811 11:06:15.865940 12287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:41241 every 8 connection(s)
I20260811 11:06:15.866242 12046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:06:15.869390 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.866971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:35319 (local address 127.25.227.62:42071)
0811 11:06:15.867051 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.867053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.867306 (+ 253us) server_negotiation.cc:407] Connection header received
0811 11:06:15.867823 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.867825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.867832 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.867884 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.869130 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.869131 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.869131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.869135 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.869148 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.869152 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.869260 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.869323 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.869336 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:06:15.869568 12299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.866953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:42071 (local address 127.25.227.2:35319)
0811 11:06:15.867184 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:15.867218 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:15.867715 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:15.867951 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:15.867954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:15.867963 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:15.868995 (+ 1032us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:06:15.868996 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:15.869024 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:06:15.869052 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:15.869258 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:15.869261 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:15.869263 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:06:15.869321 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:06:15.869369 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":129,"threads_started":1}
I20260811 11:06:15.870072 12292 heartbeater.cc:347] Connected to a master server at 127.25.227.62:42071
I20260811 11:06:15.870168 12292 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:15.870316 12292 heartbeater.cc:511] Master 127.25.227.62:42071 requested a full tablet report, sending...
I20260811 11:06:15.870704 11666 ts_manager.cc:194] Registered new tserver with Master: 1fa237757faf445ba5b5ae2d25bfb29c (127.25.227.2:41241)
I20260811 11:06:15.870829 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 12046
I20260811 11:06:15.870934 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:06:15.871151 26508 external_mini_cluster.cc:1428] Setting key 9ad5393a7e1700dccd2b09e40574e9f3
I20260811 11:06:15.872032 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:42071
--builtin_ntp_servers=127.25.227.20:37521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 11:06:15.955358 12300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:15.955564 12300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:15.955587 12300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:15.956691 12300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:15.956728 12300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:15.956753 12300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:06:15.958071 12300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:42071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:15.958366 12300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:15.958645 12300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:15.963747 12312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.963795 12300 server_base.cc:1034] running on GCE node
W20260811 11:06:15.963702 12311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:15.963948 12315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:15.964211 12300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:15.964471 12300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:15.965629 12300 hybrid_clock.cc:648] HybridClock initialized: now 1786446375965668 us; error 96 us; skew 500 ppm
I20260811 11:06:15.967079 12300 webserver.cc:460] Webserver started at http://127.25.227.3:37913/ using document root <none> and password file <none>
I20260811 11:06:15.967362 12300 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:15.967437 12300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:15.967555 12300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:15.968720 12300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "ce14357c190c4cb6ae5b69cbc209c50a"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "3c50a591392d8684c7319b155e1071dc"
server_key_iv: "bd462dd1cae29b7593a726f13b634127"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.969082 12300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "ce14357c190c4cb6ae5b69cbc209c50a"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "3c50a591392d8684c7319b155e1071dc"
server_key_iv: "bd462dd1cae29b7593a726f13b634127"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.970415 12300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:15.971138 12321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.971328 12300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:06:15.971405 12300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "ce14357c190c4cb6ae5b69cbc209c50a"
format_stamp: "Formatted at 2026-08-11 11:06:15 on dist-test-slave-z8x9"
server_key: "3c50a591392d8684c7319b155e1071dc"
server_key_iv: "bd462dd1cae29b7593a726f13b634127"
server_key_version: "encryptionkey@0"
I20260811 11:06:15.971498 12300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:15.975392 12300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:15.975680 12300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:15.975816 12300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:15.976013 12300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:15.976328 12300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:15.976362 12300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.976411 12300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:15.976439 12300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:15.982698 12300 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:45333
I20260811 11:06:15.982753 12558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:45333 every 8 connection(s)
I20260811 11:06:15.983060 12300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:06:15.986150 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.983767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:50815 (local address 127.25.227.62:42071)
0811 11:06:15.983812 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.983813 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.984045 (+ 232us) server_negotiation.cc:407] Connection header received
0811 11:06:15.984555 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.984557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.984564 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.984631 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.985872 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:15.985874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:15.985874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:06:15.985879 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:15.985896 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:06:15.985901 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:15.985970 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:15.986058 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 11:06:15.986076 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:06:15.986358 12567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:15.983737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:42071 (local address 127.25.227.3:50815)
0811 11:06:15.983924 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:15.983958 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:15.984448 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:15.984703 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:15.984707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:15.984717 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:15.985677 (+ 960us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:06:15.985677 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:15.985706 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:06:15.985736 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:15.985967 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:15.985974 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:15.985977 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:06:15.986069 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 11:06:15.986130 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260811 11:06:15.986806 12560 heartbeater.cc:347] Connected to a master server at 127.25.227.62:42071
I20260811 11:06:15.986886 12560 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:15.987047 12560 heartbeater.cc:511] Master 127.25.227.62:42071 requested a full tablet report, sending...
I20260811 11:06:15.987414 11666 ts_manager.cc:194] Registered new tserver with Master: ce14357c190c4cb6ae5b69cbc209c50a (127.25.227.3:45333)
I20260811 11:06:15.987851 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 12300
I20260811 11:06:15.987926 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:06:15.988119 26508 external_mini_cluster.cc:1428] Setting key 167a8fbb1307acaeed1bb13f743a5bf6
I20260811 11:06:15.988871 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 11:06:15.990597 11744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:06:15.990154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60444 (local address 127.25.227.62:42071)
0811 11:06:15.990212 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:15.990214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:15.990341 (+ 127us) server_negotiation.cc:407] Connection header received
0811 11:06:15.990379 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:15.990380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:15.990384 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:15.990437 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:15.990526 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60444: BlockingRecv error: recv got EOF from 127.0.0.1:60444 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:06:15.990706 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 11788
I20260811 11:06:16.025377 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 12046
I20260811 11:06:16.039342 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 12300
I20260811 11:06:16.051208 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 11619
2026-08-11T11:06:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (634 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:06:16 dist-test-slave-z8x9 krb5kdc[12580](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:06:16 dist-test-slave-z8x9 krb5kdc[12580](info): set up 2 sockets
Aug 11 11:06:16 dist-test-slave-z8x9 krb5kdc[12580](info): commencing operation
krb5kdc: starting...
W20260811 11:06:17.362561 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:06:17 dist-test-slave-z8x9 krb5kdc[12580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:06:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:06:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:06:17.485579 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35627
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35627
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:06:17.569871 12608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:17.570122 12608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:17.570159 12608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:17.571317 12608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:06:17.571382 12608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:17.571405 12608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:17.571427 12608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:06:17.571455 12608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:06:17.572966 12608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35627
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:17.573280 12608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:17.573513 12608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:17.578337 12623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:17.578428 12624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:17.578388 12626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:17.578548 12608 server_base.cc:1034] running on GCE node
I20260811 11:06:17.578790 12608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:17.579041 12608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:17.580184 12608 hybrid_clock.cc:648] HybridClock initialized: now 1786446377580176 us; error 56 us; skew 500 ppm
Aug 11 11:06:17 dist-test-slave-z8x9 krb5kdc[12580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:06:17.582845 12608 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:06:17.583333 12608 webserver.cc:460] Webserver started at http://127.25.227.62:34459/ using document root <none> and password file <none>
I20260811 11:06:17.583565 12608 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:17.583612 12608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:17.583766 12608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:17.584844 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "be05330392814029a06137af78493bb0"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "aed460505fa9a5e5e8f0fbb00d19b541"
server_key_iv: "68c9d2876f5e8a67550c4e5439ed2017"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.585268 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "be05330392814029a06137af78493bb0"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "aed460505fa9a5e5e8f0fbb00d19b541"
server_key_iv: "68c9d2876f5e8a67550c4e5439ed2017"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.586689 12608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:17.587409 12656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:17.587581 12608 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:17.587672 12608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "be05330392814029a06137af78493bb0"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "aed460505fa9a5e5e8f0fbb00d19b541"
server_key_iv: "68c9d2876f5e8a67550c4e5439ed2017"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.587744 12608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:17.603587 12608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:17.606313 12608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:17.606477 12608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:17.610551 12608 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35627
I20260811 11:06:17.610611 12742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35627 every 8 connection(s)
I20260811 11:06:17.610965 12608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:06:17.612047 12744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:06:17.614601 12744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0: Bootstrap starting.
I20260811 11:06:17.615247 12744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0: Neither blocks nor log segments found. Creating new log.
I20260811 11:06:17.615512 12744 log.cc:824] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0: Log is configured to *not* fsync() on all Append() calls
I20260811 11:06:17.616197 12744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0: No bootstrap required, opened a new log
I20260811 11:06:17.617902 12744 raft_consensus.cc:348] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be05330392814029a06137af78493bb0" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35627 } }
I20260811 11:06:17.618039 12744 raft_consensus.cc:374] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:06:17.618062 12744 raft_consensus.cc:729] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be05330392814029a06137af78493bb0, State: Initialized, Role: FOLLOWER
I20260811 11:06:17.618175 12744 consensus_queue.cc:260] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be05330392814029a06137af78493bb0" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35627 } }
I20260811 11:06:17.618227 12744 raft_consensus.cc:388] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:06:17.618248 12744 raft_consensus.cc:482] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:06:17.618319 12744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:06:17.619102 12744 raft_consensus.cc:504] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be05330392814029a06137af78493bb0" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35627 } }
I20260811 11:06:17.619199 12744 leader_election.cc:302] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be05330392814029a06137af78493bb0; no voters:
I20260811 11:06:17.619366 12744 leader_election.cc:288] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:06:17.619427 12748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:06:17.619617 12748 raft_consensus.cc:686] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [term 1 LEADER]: Becoming Leader. State: Replica: be05330392814029a06137af78493bb0, State: Running, Role: LEADER
I20260811 11:06:17.619621 12744 sys_catalog.cc:564] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:06:17.619741 12748 consensus_queue.cc:237] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be05330392814029a06137af78493bb0" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35627 } }
I20260811 11:06:17.620138 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be05330392814029a06137af78493bb0. Latest consensus state: current_term: 1 leader_uuid: "be05330392814029a06137af78493bb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be05330392814029a06137af78493bb0" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35627 } } }
I20260811 11:06:17.620126 12749 sys_catalog.cc:455] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be05330392814029a06137af78493bb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be05330392814029a06137af78493bb0" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35627 } } }
I20260811 11:06:17.620235 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [sys.catalog]: This master's current role is: LEADER
I20260811 11:06:17.620244 12749 sys_catalog.cc:458] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0 [sys.catalog]: This master's current role is: LEADER
I20260811 11:06:17.620815 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 12608
I20260811 11:06:17.620842 12761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:06:17.620937 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:06:17.621196 26508 external_mini_cluster.cc:1428] Setting key 84fe4a7a75838fcfc2dad19a27339f6b
I20260811 11:06:17.621399 12761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:06:17.622956 12761 catalog_manager.cc:1347] Generated new cluster ID: 3334a16464ab444e8be22b9cefcf50e0
I20260811 11:06:17.623013 12761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:06:17 dist-test-slave-z8x9 krb5kdc[12580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:06:17.633236 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:17.621660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48578 (local address 127.25.227.62:35627)
0811 11:06:17.621878 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:17.621887 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:17.622474 (+ 587us) server_negotiation.cc:407] Connection header received
0811 11:06:17.622603 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:17.622609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:17.622652 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:17.622795 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:17.623550 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:17.624981 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:17.626023 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:17.626680 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:17.626795 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:17.629591 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:17.629595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:17.629596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:06:17.629609 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:17.631584 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:17.632000 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:17.632003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:17.632003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:17.632108 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:17.632315 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:17.632316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:17.632316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:17.632593 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:17.632734 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:17.632846 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 11:06:17.632971 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":96,"threads_started":1}
I20260811 11:06:17.638613 12761 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:06:17.639101 12761 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:06:17.645311 12761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0: Generated new TSK 0
I20260811 11:06:17.645500 12761 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:06:17.676086 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35627
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:06:17.789073 12796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:17.789361 12796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:17.789386 12796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:17.790656 12796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:17.790699 12796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:17.790741 12796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:06:17.792377 12796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:17.792642 12796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:17.792878 12796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:17.798012 12806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:17.798074 12807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:17.798008 12809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:17.798427 12796 server_base.cc:1034] running on GCE node
I20260811 11:06:17.798595 12796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:17.798790 12796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:17.799958 12796 hybrid_clock.cc:648] HybridClock initialized: now 1786446377799949 us; error 28 us; skew 500 ppm
Aug 11 11:06:17 dist-test-slave-z8x9 krb5kdc[12580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:06:17.802630 12796 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:06:17.803108 12796 webserver.cc:460] Webserver started at http://127.25.227.1:39655/ using document root <none> and password file <none>
I20260811 11:06:17.803349 12796 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:17.803397 12796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:17.803565 12796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:17.804625 12796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "d486663c6c8b479d9316b282d73e6bbe"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "f08337b339f77542ad41537d8dc457e2"
server_key_iv: "684caa59c65cdec6b232df40124c5b00"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.804988 12796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "d486663c6c8b479d9316b282d73e6bbe"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "f08337b339f77542ad41537d8dc457e2"
server_key_iv: "684caa59c65cdec6b232df40124c5b00"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.806391 12796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:06:17.807103 12830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:17.807282 12796 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:06:17.807387 12796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "d486663c6c8b479d9316b282d73e6bbe"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "f08337b339f77542ad41537d8dc457e2"
server_key_iv: "684caa59c65cdec6b232df40124c5b00"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.807461 12796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:17.830107 12796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:17.832263 12796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:17.832458 12796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:17.832737 12796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:17.833065 12796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:17.833118 12796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:17.833161 12796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:17.833209 12796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:17.839262 12796 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:42129
I20260811 11:06:17.839303 13049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:42129 every 8 connection(s)
I20260811 11:06:17.839635 12796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:06:17.842727 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 12796
I20260811 11:06:17.842846 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:06:17.843026 26508 external_mini_cluster.cc:1428] Setting key daa91d9913dd5f68876b7957a7ee7dc8
Aug 11 11:06:17 dist-test-slave-z8x9 krb5kdc[12580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:06:17.849380 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:17.840341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:50103 (local address 127.25.227.62:35627)
0811 11:06:17.840409 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:17.840412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:17.840638 (+ 226us) server_negotiation.cc:407] Connection header received
0811 11:06:17.841140 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:17.841141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:17.841152 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:17.841251 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:17.842192 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:17.842715 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:17.843982 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:17.844212 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:17.844288 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:17.846544 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:17.846546 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:17.846547 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:06:17.846555 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:17.847914 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:17.848342 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:17.848343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:17.848344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:17.848410 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:17.848664 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:17.848666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:17.848666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:17.848802 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:17.848878 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:17.849184 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 11:06:17.849285 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:06:17.849592 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:17.840329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35627 (local address 127.25.227.1:50103)
0811 11:06:17.840525 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:17.840567 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:17.841053 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:17.841318 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:17.841322 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:17.841912 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:17.842113 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:17.842118 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:17.842827 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:17.842829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:17.843901 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:17.843904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:17.844299 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:17.844301 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:17.844440 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:17.844996 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:17.845005 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:17.846449 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:17.848010 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:06:17.848018 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:06:17.848021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:06:17.848265 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:06:17.848479 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:06:17.848480 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:06:17.848480 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:06:17.848597 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:06:17.848869 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:17.848877 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:17.849021 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 11:06:17.849132 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:06:17.849341 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":103,"threads_started":1}
I20260811 11:06:17.850109 13050 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35627
I20260811 11:06:17.850198 13050 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:17.850412 13050 heartbeater.cc:511] Master 127.25.227.62:35627 requested a full tablet report, sending...
I20260811 11:06:17.851006 12688 ts_manager.cc:194] Registered new tserver with Master: d486663c6c8b479d9316b282d73e6bbe (127.25.227.1:42129)
I20260811 11:06:17.851643 12688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:50103
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:06:17.869961 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35627
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:06:17.953661 13056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:17.953886 13056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:17.953909 13056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:17.955075 13056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:17.955180 13056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:17.955252 13056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:06:17.956801 13056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:17.957098 13056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:17.957376 13056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:17.962442 13067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:17.962617 13056 server_base.cc:1034] running on GCE node
W20260811 11:06:17.962419 13065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:17.962409 13062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:17.962910 13056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:17.963124 13056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:17.964267 13056 hybrid_clock.cc:648] HybridClock initialized: now 1786446377964258 us; error 48 us; skew 500 ppm
Aug 11 11:06:17 dist-test-slave-z8x9 krb5kdc[12580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:06:17.966840 13056 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:06:17.967316 13056 webserver.cc:460] Webserver started at http://127.25.227.2:40069/ using document root <none> and password file <none>
I20260811 11:06:17.967571 13056 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:17.967645 13056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:17.967793 13056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:17.968858 13056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "72e9f6d12fe94129a4b8f4632a8f9840"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "4d4a6d661976d639c568f7a1eb44ba55"
server_key_iv: "cef47b5e0b27abd87a5be8401444ef01"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.969292 13056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "72e9f6d12fe94129a4b8f4632a8f9840"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "4d4a6d661976d639c568f7a1eb44ba55"
server_key_iv: "cef47b5e0b27abd87a5be8401444ef01"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.970706 13056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:06:17.971545 13083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:17.971747 13056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:06:17.971855 13056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "72e9f6d12fe94129a4b8f4632a8f9840"
format_stamp: "Formatted at 2026-08-11 11:06:17 on dist-test-slave-z8x9"
server_key: "4d4a6d661976d639c568f7a1eb44ba55"
server_key_iv: "cef47b5e0b27abd87a5be8401444ef01"
server_key_version: "encryptionkey@0"
I20260811 11:06:17.971938 13056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:18.002745 13056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:18.004783 13056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:18.004962 13056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:18.005278 13056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:18.005618 13056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:18.005672 13056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:18.005708 13056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:18.005735 13056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:18.012356 13056 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:44327
I20260811 11:06:18.012409 13323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:44327 every 8 connection(s)
I20260811 11:06:18.012745 13056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:06:18.015544 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 13056
I20260811 11:06:18.015666 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:06:18.015864 26508 external_mini_cluster.cc:1428] Setting key 6760474c335cfc13ef42dd8bc16e907f
Aug 11 11:06:18 dist-test-slave-z8x9 krb5kdc[12580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446377, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:06:18.023759 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.013539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:55441 (local address 127.25.227.62:35627)
0811 11:06:18.013614 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.013617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.013847 (+ 230us) server_negotiation.cc:407] Connection header received
0811 11:06:18.014449 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.014450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.014462 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.014524 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:18.015682 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.016412 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.017933 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.018119 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.018173 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.020732 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:18.020733 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:18.020734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:06:18.020741 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:18.022318 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:18.022758 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:18.022759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:18.022759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:18.022824 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:18.023082 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:18.023083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:18.023083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:18.023209 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:18.023283 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.023560 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.023651 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:06:18.023962 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.013520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35627 (local address 127.25.227.2:55441)
0811 11:06:18.013711 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.013754 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.014244 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.014602 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.014606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.015216 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:18.015562 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.015569 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.016516 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.016517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.017846 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.017849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.018197 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.018198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.018357 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.018972 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:18.018980 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:18.020622 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:18.022413 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:06:18.022421 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:06:18.022424 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:06:18.022664 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:06:18.022896 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:06:18.022897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:06:18.022897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:06:18.023009 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:06:18.023276 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:18.023283 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:18.023426 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.023537 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.023704 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260811 11:06:18.024470 13325 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35627
I20260811 11:06:18.024565 13325 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:18.024771 13325 heartbeater.cc:511] Master 127.25.227.62:35627 requested a full tablet report, sending...
I20260811 11:06:18.025224 12688 ts_manager.cc:194] Registered new tserver with Master: 72e9f6d12fe94129a4b8f4632a8f9840 (127.25.227.2:44327)
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
I20260811 11:06:18.025763 12688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:55441
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:06:18.042315 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35627
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:44167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:06:18.126381 13340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:06:18.126585 13340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:06:18.126608 13340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:06:18.127724 13340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:06:18.127765 13340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:06:18.127791 13340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:06:18.129264 13340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:44167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35627
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:06:18.129462 13340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:06:18.129638 13340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:06:18.134460 13357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:18.134471 13354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:06:18.134478 13353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:06:18.134727 13340 server_base.cc:1034] running on GCE node
I20260811 11:06:18.134893 13340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:06:18.135080 13340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:06:18.136214 13340 hybrid_clock.cc:648] HybridClock initialized: now 1786446378136190 us; error 36 us; skew 500 ppm
Aug 11 11:06:18 dist-test-slave-z8x9 krb5kdc[12580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446378, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:06:18.138825 13340 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:06:18.139273 13340 webserver.cc:460] Webserver started at http://127.25.227.3:35731/ using document root <none> and password file <none>
I20260811 11:06:18.139508 13340 fs_manager.cc:359] Metadata directory not provided
I20260811 11:06:18.139573 13340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:06:18.139721 13340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:06:18.140751 13340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "6d35d83cf1aa49cb815cfc11f4568046"
format_stamp: "Formatted at 2026-08-11 11:06:18 on dist-test-slave-z8x9"
server_key: "3d44f6c69a98cfaafd9ff0304fc38a38"
server_key_iv: "a7d507bdaeb71174d014eb5837e2dba6"
server_key_version: "encryptionkey@0"
I20260811 11:06:18.141121 13340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "6d35d83cf1aa49cb815cfc11f4568046"
format_stamp: "Formatted at 2026-08-11 11:06:18 on dist-test-slave-z8x9"
server_key: "3d44f6c69a98cfaafd9ff0304fc38a38"
server_key_iv: "a7d507bdaeb71174d014eb5837e2dba6"
server_key_version: "encryptionkey@0"
I20260811 11:06:18.142495 13340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:06:18.143198 13371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:18.143359 13340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:06:18.143457 13340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "6d35d83cf1aa49cb815cfc11f4568046"
format_stamp: "Formatted at 2026-08-11 11:06:18 on dist-test-slave-z8x9"
server_key: "3d44f6c69a98cfaafd9ff0304fc38a38"
server_key_iv: "a7d507bdaeb71174d014eb5837e2dba6"
server_key_version: "encryptionkey@0"
I20260811 11:06:18.143533 13340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:06:18.161916 13340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:06:18.164294 13340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:06:18.164456 13340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:06:18.164695 13340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:06:18.165025 13340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:06:18.165087 13340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:18.165130 13340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:06:18.165169 13340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:06:18.171447 13340 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:45211
I20260811 11:06:18.171502 13617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:45211 every 8 connection(s)
I20260811 11:06:18.171815 13340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:06:18 dist-test-slave-z8x9 krb5kdc[12580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446378, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:06:18.178079 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 13340
I20260811 11:06:18.178182 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:06:18.178359 26508 external_mini_cluster.cc:1428] Setting key 176edcecb0b2e580d7b5da1a65e9a012
I20260811 11:06:18.181695 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.172562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:55509 (local address 127.25.227.62:35627)
0811 11:06:18.172630 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.172632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.172828 (+ 196us) server_negotiation.cc:407] Connection header received
0811 11:06:18.173405 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.173406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.173417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.173473 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:18.174451 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.175039 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.176114 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.176306 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.176362 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.178577 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:18.178579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:18.178579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:06:18.178588 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:18.180453 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:18.180824 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:18.180825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:18.180826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:18.180880 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:18.181088 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:18.181089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:18.181090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:18.181273 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:18.181329 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.181565 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.181631 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:06:18.181859 13621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.172517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35627 (local address 127.25.227.3:55509)
0811 11:06:18.172685 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.172729 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.173295 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.173542 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.173545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.174129 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:06:18.174364 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.174370 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.175128 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.175129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.176042 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.176045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.176386 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.176387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.176485 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.176932 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:06:18.176940 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:06:18.178471 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:06:18.180524 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:06:18.180531 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:06:18.180533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:06:18.180758 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:06:18.180935 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:06:18.180936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:06:18.180936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:06:18.181038 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:06:18.181329 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:06:18.181334 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:06:18.181449 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.181537 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.181659 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260811 11:06:18.182353 13618 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35627
I20260811 11:06:18.182468 13618 heartbeater.cc:464] Registering TS with master...
I20260811 11:06:18.182653 13618 heartbeater.cc:511] Master 127.25.227.62:35627 requested a full tablet report, sending...
I20260811 11:06:18.183027 12688 ts_manager.cc:194] Registered new tserver with Master: 6d35d83cf1aa49cb815cfc11f4568046 (127.25.227.3:45211)
I20260811 11:06:18.183400 12688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:55509
I20260811 11:06:18.190331 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:06:18.197558 12784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.191657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48584 (local address 127.25.227.62:35627)
0811 11:06:18.191735 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.191737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.191869 (+ 132us) server_negotiation.cc:407] Connection header received
0811 11:06:18.191914 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.191915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.191924 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.191977 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:06:18.192491 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.192977 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.193735 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.193928 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.193991 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.195077 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:06:18.195079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:06:18.195079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:06:18.195084 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:06:18.196519 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:18.196822 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:18.196823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:18.196823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:18.196867 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:06:18.197016 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:06:18.197017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:06:18.197017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:06:18.197159 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:06:18.197343 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.197428 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.197492 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:06:18.199329 12688 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48584:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:06:18.200946 12688 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:06:18.207968 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.203525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57502 (local address 127.25.227.3:45211)
0811 11:06:18.203784 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.203789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.204081 (+ 292us) server_negotiation.cc:407] Connection header received
0811 11:06:18.204206 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.204209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.204227 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.204323 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:06:18.204584 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.205663 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.206981 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.207531 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.207591 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.207632 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.207833 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.207876 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":103,"threads_started":1}
I20260811 11:06:18.207988 13648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.203407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:45211 (local address 127.0.0.1:57502)
0811 11:06:18.204013 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.204024 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.204114 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.204403 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.204404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.204407 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:06:18.204488 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.204490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.205778 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.205779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.206897 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.206899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.207615 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.207617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.207704 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.207721 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.207815 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.207877 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":27,"thread_start_us":147,"threads_started":1}
I20260811 11:06:18.208153 13647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.203600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50460 (local address 127.25.227.2:44327)
0811 11:06:18.203820 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.203825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.203841 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:06:18.203886 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.203888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.203905 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.203997 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:06:18.205337 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.206138 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.207123 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.207634 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.207707 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.207761 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.208033 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.208078 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":91,"threads_started":1}
I20260811 11:06:18.208287 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.203384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:44327 (local address 127.0.0.1:50460)
0811 11:06:18.203632 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.203679 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.203774 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.204013 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.205194 (+ 1181us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.205200 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:06:18.205260 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.205263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.206245 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.206245 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.207033 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.207037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.207724 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.207725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.207797 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.207801 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.207861 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.207901 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":73,"threads_started":1}
I20260811 11:06:18.208848 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.203602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:42129 (local address 127.0.0.1:47386)
0811 11:06:18.204209 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.204218 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.204273 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.204499 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.204500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.204503 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:06:18.204568 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.204570 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.205538 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.205539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.206893 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.206896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.208624 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.208625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.208691 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.208694 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.208749 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.208789 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260811 11:06:18.208894 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.203818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47386 (local address 127.25.227.1:42129)
0811 11:06:18.204020 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.204024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.204334 (+ 310us) server_negotiation.cc:407] Connection header received
0811 11:06:18.204384 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.204386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.204401 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.204488 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:06:18.204634 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.205433 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.207663 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.208473 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.208536 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.208589 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.208774 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.208819 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":98,"threads_started":1}
I20260811 11:06:18.209113 13148 tablet_service.cc:1467] Processing CreateTablet for tablet 5d1b8648cfc244f994b4388a319fc71d (DEFAULT_TABLE table=test-table [id=f6bbabc19599456ca79dca1c7304dbd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:06:18.209559 13148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d1b8648cfc244f994b4388a319fc71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:06:18.209800 12921 tablet_service.cc:1467] Processing CreateTablet for tablet 5d1b8648cfc244f994b4388a319fc71d (DEFAULT_TABLE table=test-table [id=f6bbabc19599456ca79dca1c7304dbd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:06:18.210136 12921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d1b8648cfc244f994b4388a319fc71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:06:18.213167 13652 tablet_bootstrap.cc:492] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Bootstrap starting.
I20260811 11:06:18.213609 13469 tablet_service.cc:1467] Processing CreateTablet for tablet 5d1b8648cfc244f994b4388a319fc71d (DEFAULT_TABLE table=test-table [id=f6bbabc19599456ca79dca1c7304dbd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:06:18.213825 13653 tablet_bootstrap.cc:492] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: Bootstrap starting.
I20260811 11:06:18.213968 13469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d1b8648cfc244f994b4388a319fc71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:06:18.214049 13652 tablet_bootstrap.cc:654] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Neither blocks nor log segments found. Creating new log.
I20260811 11:06:18.214471 13653 tablet_bootstrap.cc:654] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: Neither blocks nor log segments found. Creating new log.
I20260811 11:06:18.214600 13652 log.cc:824] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Log is configured to *not* fsync() on all Append() calls
I20260811 11:06:18.215075 13653 log.cc:824] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: Log is configured to *not* fsync() on all Append() calls
I20260811 11:06:18.215422 13652 tablet_bootstrap.cc:492] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: No bootstrap required, opened a new log
I20260811 11:06:18.215507 13652 ts_tablet_manager.cc:1397] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:06:18.215889 13653 tablet_bootstrap.cc:492] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: No bootstrap required, opened a new log
I20260811 11:06:18.215963 13653 ts_tablet_manager.cc:1397] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:06:18.216972 13652 raft_consensus.cc:348] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.217195 13652 raft_consensus.cc:374] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:06:18.217248 13652 raft_consensus.cc:729] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e9f6d12fe94129a4b8f4632a8f9840, State: Initialized, Role: FOLLOWER
I20260811 11:06:18.217376 13652 consensus_queue.cc:260] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.217675 13652 ts_tablet_manager.cc:1428] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:06:18.217710 13325 heartbeater.cc:503] Master 127.25.227.62:35627 was elected leader, sending a full tablet report...
I20260811 11:06:18.217887 13661 tablet_bootstrap.cc:492] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Bootstrap starting.
I20260811 11:06:18.218152 13653 raft_consensus.cc:348] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.218307 13653 raft_consensus.cc:374] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:06:18.218350 13653 raft_consensus.cc:729] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d486663c6c8b479d9316b282d73e6bbe, State: Initialized, Role: FOLLOWER
I20260811 11:06:18.218482 13653 consensus_queue.cc:260] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.218538 13661 tablet_bootstrap.cc:654] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Neither blocks nor log segments found. Creating new log.
I20260811 11:06:18.218797 13653 ts_tablet_manager.cc:1428] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:06:18.218845 13050 heartbeater.cc:503] Master 127.25.227.62:35627 was elected leader, sending a full tablet report...
I20260811 11:06:18.219129 13661 log.cc:824] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Log is configured to *not* fsync() on all Append() calls
I20260811 11:06:18.219980 13661 tablet_bootstrap.cc:492] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: No bootstrap required, opened a new log
I20260811 11:06:18.220065 13661 ts_tablet_manager.cc:1397] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:06:18.221396 13662 raft_consensus.cc:482] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:06:18.221498 13662 raft_consensus.cc:504] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.221828 13662 leader_election.cc:288] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d35d83cf1aa49cb815cfc11f4568046 (127.25.227.3:45211), d486663c6c8b479d9316b282d73e6bbe (127.25.227.1:42129)
I20260811 11:06:18.221837 13661 raft_consensus.cc:348] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.222003 13661 raft_consensus.cc:374] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:06:18.222046 13661 raft_consensus.cc:729] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d35d83cf1aa49cb815cfc11f4568046, State: Initialized, Role: FOLLOWER
I20260811 11:06:18.222220 13661 consensus_queue.cc:260] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.222529 13618 heartbeater.cc:503] Master 127.25.227.62:35627 was elected leader, sending a full tablet report...
I20260811 11:06:18.222532 13661 ts_tablet_manager.cc:1428] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 11:06:18.225077 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.222099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:57499 (local address 127.25.227.3:45211)
0811 11:06:18.222144 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.222146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.222226 (+ 80us) server_negotiation.cc:407] Connection header received
0811 11:06:18.222326 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.222327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.222336 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.222368 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:06:18.222593 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.223090 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.224357 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.224722 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.224815 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.224824 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.224975 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.225010 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:06:18.225083 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.222054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:56501 (local address 127.25.227.1:42129)
0811 11:06:18.222193 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.222194 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.222202 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:06:18.222226 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.222227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.222236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.222286 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:06:18.222440 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.223062 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.224340 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.224731 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.224814 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.224823 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.224981 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.225017 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 11:06:18.225097 13332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.221988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:42129 (local address 127.25.227.2:56501)
0811 11:06:18.222070 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.222083 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.222123 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.222288 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.222289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.222291 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:06:18.222362 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.222364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.223157 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.223158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.224249 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.224252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.224811 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.224812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.224908 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.224911 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.224975 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.225016 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 11:06:18.225111 13665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.221992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:45211 (local address 127.25.227.2:57499)
0811 11:06:18.222164 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.222174 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:06:18.222254 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:06:18.222437 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:06:18.222437 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:06:18.222439 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:06:18.222508 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.222509 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.223166 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.223167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.224262 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:06:18.224265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.224817 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.224818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:06:18.224887 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.224891 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:06:18.224967 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:06:18.225009 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":25,"thread_start_us":82,"threads_started":1}
I20260811 11:06:18.225448 13513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d1b8648cfc244f994b4388a319fc71d" candidate_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d35d83cf1aa49cb815cfc11f4568046" is_pre_election: true
I20260811 11:06:18.225545 13513 raft_consensus.cc:2454] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e9f6d12fe94129a4b8f4632a8f9840 in term 0.
I20260811 11:06:18.225723 12959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d1b8648cfc244f994b4388a319fc71d" candidate_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d486663c6c8b479d9316b282d73e6bbe" is_pre_election: true
I20260811 11:06:18.225754 13088 leader_election.cc:302] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d35d83cf1aa49cb815cfc11f4568046, 72e9f6d12fe94129a4b8f4632a8f9840; no voters:
I20260811 11:06:18.225852 12959 raft_consensus.cc:2454] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e9f6d12fe94129a4b8f4632a8f9840 in term 0.
I20260811 11:06:18.225868 13662 raft_consensus.cc:2781] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:06:18.225912 13662 raft_consensus.cc:482] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:06:18.225947 13662 raft_consensus.cc:3037] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:06:18.226675 13662 raft_consensus.cc:504] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.226847 13662 leader_election.cc:288] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [CANDIDATE]: Term 1 election: Requested vote from peers 6d35d83cf1aa49cb815cfc11f4568046 (127.25.227.3:45211), d486663c6c8b479d9316b282d73e6bbe (127.25.227.1:42129)
I20260811 11:06:18.226985 13513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d1b8648cfc244f994b4388a319fc71d" candidate_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d35d83cf1aa49cb815cfc11f4568046"
I20260811 11:06:18.227034 12959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d1b8648cfc244f994b4388a319fc71d" candidate_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d486663c6c8b479d9316b282d73e6bbe"
I20260811 11:06:18.227070 13513 raft_consensus.cc:3037] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:06:18.227109 12959 raft_consensus.cc:3037] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:06:18.227737 12959 raft_consensus.cc:2454] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e9f6d12fe94129a4b8f4632a8f9840 in term 1.
I20260811 11:06:18.227751 13513 raft_consensus.cc:2454] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e9f6d12fe94129a4b8f4632a8f9840 in term 1.
I20260811 11:06:18.227913 13084 leader_election.cc:302] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72e9f6d12fe94129a4b8f4632a8f9840, d486663c6c8b479d9316b282d73e6bbe; no voters:
I20260811 11:06:18.228013 13662 raft_consensus.cc:2781] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:06:18.228173 13662 raft_consensus.cc:686] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 1 LEADER]: Becoming Leader. State: Replica: 72e9f6d12fe94129a4b8f4632a8f9840, State: Running, Role: LEADER
I20260811 11:06:18.228273 13662 consensus_queue.cc:237] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } }
I20260811 11:06:18.229022 12688 catalog_manager.cc:5495] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72e9f6d12fe94129a4b8f4632a8f9840 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72e9f6d12fe94129a4b8f4632a8f9840" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 } health_report { overall_health: UNKNOWN } } }
I20260811 11:06:18.237090 13647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.234845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.25.227.2:44327)
0811 11:06:18.234911 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:06:18.234913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:06:18.234921 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:06:18.234986 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:06:18.234987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:06:18.235005 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:06:18.235065 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:06:18.235182 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.235632 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.236388 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:06:18.236570 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:06:18.236628 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:06:18.236762 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:06:18.236859 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:06:18.236919 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:06:18.236951 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 11:06:18.236969 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:06:18.238866 12959 raft_consensus.cc:1261] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 1 FOLLOWER]: Refusing update from remote peer 72e9f6d12fe94129a4b8f4632a8f9840: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:06:18.238879 13513 raft_consensus.cc:1261] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 1 FOLLOWER]: Refusing update from remote peer 72e9f6d12fe94129a4b8f4632a8f9840: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:06:18.239210 13662 consensus_queue.cc:1035] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d35d83cf1aa49cb815cfc11f4568046" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:06:18.239349 13670 consensus_queue.cc:1035] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d486663c6c8b479d9316b282d73e6bbe" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:06:18.241904 13674 mvcc.cc:205] Tried to move back new op lower bound from 7317284365263900672 to 7317284365223702528. Current Snapshot: MvccSnapshot[applied={T|T < 7317284365263900672}]
I20260811 11:06:18.242164 13676 mvcc.cc:205] Tried to move back new op lower bound from 7317284365263900672 to 7317284365223702528. Current Snapshot: MvccSnapshot[applied={T|T < 7317284365263900672}]
I20260811 11:06:18.242798 13675 mvcc.cc:205] Tried to move back new op lower bound from 7317284365263900672 to 7317284365223702528. Current Snapshot: MvccSnapshot[applied={T|T < 7317284365263900672 or (T in {7317284365263900672})}]
I20260811 11:06:18.244493 12688 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:06:18.244603 12688 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:06:18.245427 12688 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be05330392814029a06137af78493bb0: Sending DeleteTablet for 3 replicas of tablet 5d1b8648cfc244f994b4388a319fc71d
I20260811 11:06:18.245788 13148 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d1b8648cfc244f994b4388a319fc71d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:06:18 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:50460
I20260811 11:06:18.245880 12921 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d1b8648cfc244f994b4388a319fc71d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:06:18 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:47386
I20260811 11:06:18.245882 13469 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d1b8648cfc244f994b4388a319fc71d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:06:18 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:57502
I20260811 11:06:18.246045 13691 tablet_replica.cc:330] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: stopping tablet replica
I20260811 11:06:18.246165 13696 tablet_replica.cc:330] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe: stopping tablet replica
I20260811 11:06:18.246265 13696 raft_consensus.cc:2229] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:06:18.246275 13691 raft_consensus.cc:2229] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:06:18.246387 13696 raft_consensus.cc:2258] T 5d1b8648cfc244f994b4388a319fc71d P d486663c6c8b479d9316b282d73e6bbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:06:18.246531 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 12796
I20260811 11:06:18.246553 13693 tablet_replica.cc:330] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: stopping tablet replica
I20260811 11:06:18.246644 13693 raft_consensus.cc:2229] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:06:18.246726 13693 raft_consensus.cc:2258] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:06:18.247268 13691 raft_consensus.cc:2258] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:06:18.250212 13691 ts_tablet_manager.cc:1905] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:06:18.251791 13691 ts_tablet_manager.cc:1918] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:06:18.251879 13691 log.cc:1196] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/5d1b8648cfc244f994b4388a319fc71d
I20260811 11:06:18.252158 13691 ts_tablet_manager.cc:1939] T 5d1b8648cfc244f994b4388a319fc71d P 72e9f6d12fe94129a4b8f4632a8f9840: Deleting consensus metadata
I20260811 11:06:18.252612 12657 catalog_manager.cc:4841] TS 72e9f6d12fe94129a4b8f4632a8f9840 (127.25.227.2:44327): tablet 5d1b8648cfc244f994b4388a319fc71d (table test-table [id=f6bbabc19599456ca79dca1c7304dbd5]) successfully deleted
I20260811 11:06:18.261579 13693 ts_tablet_manager.cc:1905] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:06:18.263911 13693 ts_tablet_manager.cc:1918] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:06:18.264026 13693 log.cc:1196] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/5d1b8648cfc244f994b4388a319fc71d
I20260811 11:06:18.264403 13693 ts_tablet_manager.cc:1939] T 5d1b8648cfc244f994b4388a319fc71d P 6d35d83cf1aa49cb815cfc11f4568046: Deleting consensus metadata
I20260811 11:06:18.264936 12661 catalog_manager.cc:4841] TS 6d35d83cf1aa49cb815cfc11f4568046 (127.25.227.3:45211): tablet 5d1b8648cfc244f994b4388a319fc71d (table test-table [id=f6bbabc19599456ca79dca1c7304dbd5]) successfully deleted
W20260811 11:06:18.265064 12657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:42129 (error 108)
I20260811 11:06:18.265404 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 13056
I20260811 11:06:18.265672 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:06:18.265553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:42129 (local address 127.0.0.1:47398)
0811 11:06:18.265605 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 11:06:18.265636 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:42129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 11:06:18.265784 12657 catalog_manager.cc:4584] TS d486663c6c8b479d9316b282d73e6bbe (127.25.227.1:42129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5d1b8648cfc244f994b4388a319fc71d: Network error: Client connection negotiation failed: client connection to 127.25.227.1:42129: connect: Connection refused (error 111)
I20260811 11:06:18.275964 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 13340
I20260811 11:06:18.292219 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 12608
2026-08-11T11:06:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2241 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:06:18 dist-test-slave-z8x9 krb5kdc[13707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:06:18 dist-test-slave-z8x9 krb5kdc[13707](info): set up 2 sockets
Aug 11 11:06:18 dist-test-slave-z8x9 krb5kdc[13707](info): commencing operation
krb5kdc: starting...
W20260811 11:06:19.591135 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:06:19 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:06:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:06:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/rangeradmin_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/rangeradmin_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/rangerlookup_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/rangerlookup_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
I20260811 11:06:19.760161 26508 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgatKIY/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/postgres -l logfile start
2026-08-11 11:06:22.156 UTC [13774] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 11:06:22.156 UTC [13774] LOG: listening on IPv4 address "127.25.227.20", port 43537
2026-08-11 11:06:22.159 UTC [13774] LOG: listening on Unix socket "/tmp/.s.PGSQL.43537"
2026-08-11 11:06:22.181 UTC [13779] LOG: database system was shut down at 2026-08-11 11:06:20 UTC
2026-08-11 11:06:22.185 UTC [13774] LOG: database system is ready to accept connections
I20260811 11:06:23.409106 26508 mini_postgres.cc:96] Postgres bound to 43537
2026-08-11 11:06:23.417 UTC [13796] FATAL: database "slave" does not exist
127.25.227.20:43537 - accepting connections
I20260811 11:06:23.418406 26508 mini_ranger.cc:161] Starting Ranger...
I20260811 11:06:23.434326 26508 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 11:06:23.873997 26508 mini_ranger.cc:87] Created ranger Postgres database
I20260811 11:06:23.874092 26508 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-admin
2026-08-11 11:06:24,268 [I] DB FLAVOR :POSTGRES
2026-08-11 11:06:24,269 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:06:24,269 [I] Checking connection..
2026-08-11 11:06:24,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 11:06:24,560 [I] Checking connection passed.
2026-08-11 11:06:24,561 [I] --------- Verifying version history table ---------
2026-08-11 11:06:24,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:06:24,831 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:06:24,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:06:25,096 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:06:25,096 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 11:06:25,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 11:06:25.405 UTC [13912] WARNING: there is no transaction in progress
2026-08-11 11:06:25,416 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 11:06:25,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:06:25,733 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 11:06:25,733 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:06:25,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 11:06:26,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 11:06:26,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-z8x9.c.gcp-upstream.internal','N') ;"
2026-08-11 11:06:26,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:06:26,837 [I] Table x_portal_user does not exist in database ranger
2026-08-11 11:06:26,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:06:27,121 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 11:06:27,122 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:06:27,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:06:27,643 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 11:06:27,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 11:06:28.604 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.621 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.636 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.651 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.668 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.684 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.739 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.745 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.760 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.769 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.779 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.793 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.802 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.808 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.814 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:28.820 UTC [14126] WARNING: there is no transaction in progress
2026-08-11 11:06:29,422 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 11:06:29,423 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 11:06:29,701 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 11:06:29,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:06:29,972 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 11:06:29,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:06:30,259 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 11:06:30,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:06:30,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:06:30,794 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-z8x9.c.gcp-upstream.internal';"
2026-08-11 11:06:31,068 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 11:06:31,069 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 11:06:31,358 [I] DB_PATCHES have already been applied
I20260811 11:06:31.367851 26508 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgatKIY/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 11:06:31.367944 26508 mini_ranger.cc:193] Using host: 127.25.227.20
I20260811 11:06:31.372385 26508 mini_ranger.cc:227] Ranger admin URL: http://127.25.227.20:42563
Aug 11, 2026 11:06:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:06:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:06:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 11:06:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 11:06:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 11:06:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 11:06:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 11:06:32.789963 26508 mini_ranger.cc:160] Time spent starting Ranger: real 9.372s user 0.000s sys 0.012s
Aug 11, 2026 11:06:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 11:06:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 11:06:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 11:06:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 11:06:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 11:06:54.056221 26508 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/rangerkms_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/rangerkms_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.227.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.227.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 11:06:54 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446414, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 11:06:54.138677 26508 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 11:06:54.149065 26508 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 11:06:54.977684 26508 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 11:06:54.977759 26508 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms
I20260811 11:06:54.977797 26508 mini_ranger_kms.cc:227] Using postgres at 127.25.227.20:43537
2026-08-11 11:06:55,244 [I] DB FLAVOR :POSTGRES
2026-08-11 11:06:55,245 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:06:55,245 [I] Checking connection
2026-08-11 11:06:55,245 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 11:06:55,488 [I] connection success
2026-08-11 11:06:55,489 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 11:06:55,489 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 11:06:55,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 11:06:55,775 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 11:06:55,776 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:06:55,776 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 11:06:55,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:43537/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 11:06:56,038 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 11:06:56.519111 26508 mini_ranger_kms.cc:310] Created kms service
I20260811 11:06:56.735198 26508 mini_ranger_kms.cc:326] Created kudu user
I20260811 11:06:56.779879 26508 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 11:06:56 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446414, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:06:57.210995 26508 mini_ranger_kms.cc:384] Added ranger policy
I20260811 11:06:57.211126 26508 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 11:06:57.211150 26508 mini_ranger_kms.cc:240] Using host: 127.25.227.20
I20260811 11:06:57.216228 26508 mini_ranger_kms.cc:276] Ranger KMS PID: 14477
I20260811 11:06:57.216367 26508 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.227.20:33213
Aug 11, 2026 11:06:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:06:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:06:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 11:06:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 11:06:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 11:06:58 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 11:06:59 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786446419, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.227.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 11:06:59 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446419, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.227.20@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:00.160408 26508 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.022s user 0.000s sys 0.249s
I20260811 11:07:00.160533 26508 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 11:07:00.160622 26508 mini_ranger_kms.cc:401] 127.25.227.20:33213/kms/v1/keys
Aug 11 11:07:00 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446419, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.227.20@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
Aug 11 11:07:02 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:07:02.668388 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35615
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35615
--ranger_config_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:33213/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:02.766182 14568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:02.766407 14568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:02.766429 14568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:02.767513 14568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:07:02.767546 14568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:02.767560 14568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:02.767572 14568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:07:02.767584 14568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:07:02.769284 14568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.227.20:33213/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35615
--ranger_config_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:02.769485 14568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:02.769651 14568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:07:02.775112 14568 server_base.cc:1034] running on GCE node
W20260811 11:07:02.776314 14576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:02.776476 14584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:02.776512 14577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:02.776826 14568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:02.777163 14568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:02.778394 14568 hybrid_clock.cc:648] HybridClock initialized: now 1786446422778386 us; error 41 us; skew 500 ppm
Aug 11 11:07:02 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446422, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:02.786516 14568 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:07:02.787009 14568 webserver.cc:460] Webserver started at http://127.25.227.62:36539/ using document root <none> and password file <none>
I20260811 11:07:02.787293 14568 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:02.787365 14568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:02.787528 14568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:02 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446422, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:02.846917 14568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "82d6d05445ac428488569d25a7388fe3"
format_stamp: "Formatted at 2026-08-11 11:07:02 on dist-test-slave-z8x9"
server_key: "44030afb443491ba9cd585d48cb0edb5"
server_key_iv: "50c1d6f0899efed66fd836e3f2878a2e"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:02.847486 14568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "82d6d05445ac428488569d25a7388fe3"
format_stamp: "Formatted at 2026-08-11 11:07:02 on dist-test-slave-z8x9"
server_key: "44030afb443491ba9cd585d48cb0edb5"
server_key_iv: "50c1d6f0899efed66fd836e3f2878a2e"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:02.850152 14568 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260811 11:07:02.866655 14598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:02.866900 14568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:07:02.867014 14568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "82d6d05445ac428488569d25a7388fe3"
format_stamp: "Formatted at 2026-08-11 11:07:02 on dist-test-slave-z8x9"
server_key: "44030afb443491ba9cd585d48cb0edb5"
server_key_iv: "50c1d6f0899efed66fd836e3f2878a2e"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:02.867125 14568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:02.894279 14568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:02.896391 14568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:02.896687 14568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:02.904450 14568 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35615
I20260811 11:07:02.904488 14695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35615 every 8 connection(s)
I20260811 11:07:02.904879 14568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:07:02.905797 14698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:02.907879 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 14568
I20260811 11:07:02.907971 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:07:02.908171 26508 external_mini_cluster.cc:1428] Setting key 6e2920d16e1ebb90b6ffaffea69ac79f
I20260811 11:07:02.908532 14698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3: Bootstrap starting.
I20260811 11:07:02.909371 14698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:02.909787 14698 log.cc:824] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:02.910622 14698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3: No bootstrap required, opened a new log
I20260811 11:07:02.912797 14698 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82d6d05445ac428488569d25a7388fe3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35615 } }
I20260811 11:07:02.912958 14698 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:02.913010 14698 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d6d05445ac428488569d25a7388fe3, State: Initialized, Role: FOLLOWER
I20260811 11:07:02.913159 14698 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82d6d05445ac428488569d25a7388fe3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35615 } }
I20260811 11:07:02.913302 14698 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:07:02.913339 14698 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:07:02.913421 14698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:02.914130 14698 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82d6d05445ac428488569d25a7388fe3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35615 } }
I20260811 11:07:02.914268 14698 leader_election.cc:302] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82d6d05445ac428488569d25a7388fe3; no voters:
I20260811 11:07:02.914464 14698 leader_election.cc:288] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:07:02.914520 14713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:07:02.914728 14713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [term 1 LEADER]: Becoming Leader. State: Replica: 82d6d05445ac428488569d25a7388fe3, State: Running, Role: LEADER
I20260811 11:07:02.914750 14698 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:07:02.914942 14713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82d6d05445ac428488569d25a7388fe3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35615 } }
I20260811 11:07:02.915298 14713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82d6d05445ac428488569d25a7388fe3. Latest consensus state: current_term: 1 leader_uuid: "82d6d05445ac428488569d25a7388fe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82d6d05445ac428488569d25a7388fe3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35615 } } }
I20260811 11:07:02.915380 14713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:02.915596 14721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 11:07:02 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:02.916173 14721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:07:02.916147 14718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82d6d05445ac428488569d25a7388fe3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82d6d05445ac428488569d25a7388fe3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35615 } } }
I20260811 11:07:02.916215 14718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3 [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:02.916846 14698 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 11:07:02.923794 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:02.908744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47632 (local address 127.25.227.62:35615)
0811 11:07:02.908998 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:02.909010 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:02.909049 (+ 39us) server_negotiation.cc:407] Connection header received
0811 11:07:02.909834 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:02.909844 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:02.909908 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:02.910068 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:02.910837 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:02.911752 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:02.912589 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:02.913131 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:02.913285 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:02.916309 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:02.916313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:02.916313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:02.916325 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:02.921492 (+ 5167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:02.922026 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:02.922029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:02.922030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:02.922211 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:02.922542 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:02.922543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:02.922543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:02.922904 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:02.923094 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:02.923379 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 11:07:02.923531 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
I20260811 11:07:02.925069 14721 catalog_manager.cc:1347] Generated new cluster ID: 38a6a284aa854d0aa32edbe5399b8429
I20260811 11:07:02.925124 14721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:07:02.936352 14721 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:07:02.937160 14721 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:07:02.943406 14721 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3: Generated new TSK 0
I20260811 11:07:02.943656 14721 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:07:03.762703 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:33213/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35615
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:03.870391 14788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:03.870620 14788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:03.870658 14788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:03.871872 14788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:03.871935 14788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:03.871979 14788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:07:03.873523 14788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.227.20:33213/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:03.873777 14788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:03.874022 14788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:03.880923 14801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:03.880935 14809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:03.881049 14803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:03.881687 14788 server_base.cc:1034] running on GCE node
I20260811 11:07:03.881923 14788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:03.882210 14788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:03.883395 14788 hybrid_clock.cc:648] HybridClock initialized: now 1786446423883369 us; error 40 us; skew 500 ppm
Aug 11 11:07:03 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446423, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:03.886790 14788 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:07:03.887354 14788 webserver.cc:460] Webserver started at http://127.25.227.1:37697/ using document root <none> and password file <none>
I20260811 11:07:03.887645 14788 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:03.887729 14788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:03.887908 14788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:03 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446423, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:03.904040 14788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "b8d94bbbf6ca4974b3a8899e3b550915"
format_stamp: "Formatted at 2026-08-11 11:07:03 on dist-test-slave-z8x9"
server_key: "c97cb995a42c14dd420fd0fd432e348d"
server_key_iv: "30450f5933537db004c8cba34d5cd8f6"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:03.904613 14788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "b8d94bbbf6ca4974b3a8899e3b550915"
format_stamp: "Formatted at 2026-08-11 11:07:03 on dist-test-slave-z8x9"
server_key: "c97cb995a42c14dd420fd0fd432e348d"
server_key_iv: "30450f5933537db004c8cba34d5cd8f6"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:03.908428 14788 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260811 11:07:03.920830 14826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:03.921066 14788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 11:07:03.921152 14788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "b8d94bbbf6ca4974b3a8899e3b550915"
format_stamp: "Formatted at 2026-08-11 11:07:03 on dist-test-slave-z8x9"
server_key: "c97cb995a42c14dd420fd0fd432e348d"
server_key_iv: "30450f5933537db004c8cba34d5cd8f6"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:03.921277 14788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:03.949494 14788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:03.951797 14788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:03.951977 14788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:03.952284 14788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:03.952714 14788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:03.952778 14788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:03.952849 14788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:03.952894 14788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:03.960857 14788 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:44937
I20260811 11:07:03.961185 15079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:44937 every 8 connection(s)
I20260811 11:07:03.961423 14788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:07:03.970882 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 14788
I20260811 11:07:03.971017 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:07:03.971222 26508 external_mini_cluster.cc:1428] Setting key e35693bf8e063ef76825fad769041ea7
Aug 11 11:07:03 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446423, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:03.982415 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:03.962268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:44371 (local address 127.25.227.62:35615)
0811 11:07:03.962392 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:03.962394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:03.969844 (+ 7450us) server_negotiation.cc:407] Connection header received
0811 11:07:03.970759 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:03.970761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:03.970780 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:03.970830 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:03.972385 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:03.973328 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:03.974945 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:03.975268 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:03.975316 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:03.978397 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:03.978399 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:03.978399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:03.978407 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:03.980630 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:03.981229 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:03.981231 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:03.981231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:03.981301 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:03.981603 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:03.981604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:03.981604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:03.981748 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:03.981790 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:03.982205 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 11:07:03.982300 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":63,"threads_started":1}
I20260811 11:07:03.983243 15086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:03.962251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35615 (local address 127.25.227.1:44371)
0811 11:07:03.969651 (+ 7400us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:03.969707 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:03.970607 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:03.971064 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:03.971070 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:03.971497 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:03.972264 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:03.972273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:03.973466 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:03.973467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:03.974831 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:03.974835 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:03.975419 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:03.975420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:03.975572 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:03.976333 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:03.976346 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:03.978270 (+ 1924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:03.980737 (+ 2467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:03.980748 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:03.980751 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:03.981073 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:03.981380 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:03.981381 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:03.981381 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:03.981527 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:03.981835 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:03.981842 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:03.982014 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 11:07:03.982760 (+ 746us) client_negotiation.cc:240] Negotiation successful
0811 11:07:03.982971 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7344,"thread_start_us":93,"threads_started":1}
I20260811 11:07:03.984035 15081 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35615
I20260811 11:07:03.984145 15081 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:03.984354 15081 heartbeater.cc:511] Master 127.25.227.62:35615 requested a full tablet report, sending...
I20260811 11:07:03.984921 14626 ts_manager.cc:194] Registered new tserver with Master: b8d94bbbf6ca4974b3a8899e3b550915 (127.25.227.1:44937)
I20260811 11:07:03.985903 14626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:44371
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:07:04.009886 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:33213/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35615
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 11:07:04.139117 15091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:04.139516 15091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:04.139617 15091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:04.141451 15091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:04.141587 15091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:04.141683 15091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:07:04.144095 15091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.227.20:33213/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:04.144613 15091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:04.144994 15091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:04.150913 15103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:04.151180 15111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:04.151219 15109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:04.152092 15091 server_base.cc:1034] running on GCE node
I20260811 11:07:04.152400 15091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:04.152694 15091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:04.153903 15091 hybrid_clock.cc:648] HybridClock initialized: now 1786446424153884 us; error 34 us; skew 500 ppm
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:04.156810 15091 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:07:04.157454 15091 webserver.cc:460] Webserver started at http://127.25.227.2:44457/ using document root <none> and password file <none>
I20260811 11:07:04.157704 15091 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:04.157776 15091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:04.157920 15091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:04.175196 15091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "1598abf627db481ebd9728435d556819"
format_stamp: "Formatted at 2026-08-11 11:07:04 on dist-test-slave-z8x9"
server_key: "5c5769843b1a83e5f733a9cefedd2a47"
server_key_iv: "20d9b7cd17a278641cdae5e2f4f5c721"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:04.175676 15091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "1598abf627db481ebd9728435d556819"
format_stamp: "Formatted at 2026-08-11 11:07:04 on dist-test-slave-z8x9"
server_key: "5c5769843b1a83e5f733a9cefedd2a47"
server_key_iv: "20d9b7cd17a278641cdae5e2f4f5c721"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:04.181689 15091 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 11:07:04.206877 15129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:04.207154 15091 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.000s
I20260811 11:07:04.207258 15091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "1598abf627db481ebd9728435d556819"
format_stamp: "Formatted at 2026-08-11 11:07:04 on dist-test-slave-z8x9"
server_key: "5c5769843b1a83e5f733a9cefedd2a47"
server_key_iv: "20d9b7cd17a278641cdae5e2f4f5c721"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:04.207360 15091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:04.225747 15091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:04.228514 15091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:04.228856 15091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:04.229189 15091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:04.229851 15091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:04.229983 15091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:04.230067 15091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:04.230139 15091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:04.237887 15091 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:38763
I20260811 11:07:04.238448 15091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:07:04.239066 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 15091
I20260811 11:07:04.239187 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:07:04.239478 26508 external_mini_cluster.cc:1428] Setting key 767d43ae1130a9cfdd1983e4d4f7006d
I20260811 11:07:04.244593 15342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:38763 every 8 connection(s)
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:04.257638 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.245814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:33833 (local address 127.25.227.62:35615)
0811 11:07:04.245883 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.245886 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.246571 (+ 685us) server_negotiation.cc:407] Connection header received
0811 11:07:04.247374 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.247376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.247396 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.247429 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:04.248359 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.249155 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.250784 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.251065 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.251112 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.253910 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:04.253911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:04.253912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:04.253919 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:04.255748 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:04.256316 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:04.256318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:04.256318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:04.256388 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:04.256727 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:04.256728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:04.256729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:04.256886 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:04.256937 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.257414 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.257512 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 11:07:04.258548 15346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.245486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35615 (local address 127.25.227.2:33833)
0811 11:07:04.246415 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.246469 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.247237 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.247628 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.247633 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.247939 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:04.248231 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.248238 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.249322 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.249323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.250666 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.250669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.251216 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.251216 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.251367 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.252046 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:04.252057 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:04.253794 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:04.255848 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:04.255855 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:04.255858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:04.256206 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:04.256474 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:04.256474 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:04.256475 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:04.256622 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:04.256995 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:04.257002 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:04.257234 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.258050 (+ 816us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.258228 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":106,"threads_started":1}
I20260811 11:07:04.259402 15343 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35615
I20260811 11:07:04.259522 15343 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:04.259757 15343 heartbeater.cc:511] Master 127.25.227.62:35615 requested a full tablet report, sending...
I20260811 11:07:04.260167 14626 ts_manager.cc:194] Registered new tserver with Master: 1598abf627db481ebd9728435d556819 (127.25.227.2:38763)
I20260811 11:07:04.260648 14626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:33833
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:07:04.292402 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:33213/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35615
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:04.431100 15349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:04.431325 15349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:04.431351 15349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:04.432511 15349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:04.432555 15349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:04.432581 15349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:07:04.434154 15349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.227.20:33213/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:04.434417 15349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:04.434696 15349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:04.440122 15370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:04.440132 15364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:04.440193 15363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:04.440829 15349 server_base.cc:1034] running on GCE node
I20260811 11:07:04.441087 15349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:04.441458 15349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:04.442662 15349 hybrid_clock.cc:648] HybridClock initialized: now 1786446424442645 us; error 42 us; skew 500 ppm
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:04.446229 15349 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:07:04.446758 15349 webserver.cc:460] Webserver started at http://127.25.227.3:39677/ using document root <none> and password file <none>
I20260811 11:07:04.447074 15349 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:04.447206 15349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:04.447382 15349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:04.469250 15349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "9517c917b77844a1a4da3dc34523939f"
format_stamp: "Formatted at 2026-08-11 11:07:04 on dist-test-slave-z8x9"
server_key: "ea9e83313d799cdb115e74ff0a30f1f4"
server_key_iv: "e70774b9e0068ff935dd518973056772"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:04.469784 15349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "9517c917b77844a1a4da3dc34523939f"
format_stamp: "Formatted at 2026-08-11 11:07:04 on dist-test-slave-z8x9"
server_key: "ea9e83313d799cdb115e74ff0a30f1f4"
server_key_iv: "e70774b9e0068ff935dd518973056772"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:04.475004 15349 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.002s
I20260811 11:07:04.498121 15383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:04.498397 15349 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:07:04.498507 15349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "9517c917b77844a1a4da3dc34523939f"
format_stamp: "Formatted at 2026-08-11 11:07:04 on dist-test-slave-z8x9"
server_key: "ea9e83313d799cdb115e74ff0a30f1f4"
server_key_iv: "e70774b9e0068ff935dd518973056772"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:04.498606 15349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:04.513480 15349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:04.519191 15349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:04.519623 15349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:04.519938 15349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:04.520364 15349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:04.520459 15349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:04.520536 15349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:04.520599 15349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:04.529193 15349 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:36999
I20260811 11:07:04.530850 15349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:07:04.531745 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 15349
I20260811 11:07:04.531857 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:07:04.532045 26508 external_mini_cluster.cc:1428] Setting key c0b4a91b1753b6f13b745ed5201adbde
I20260811 11:07:04.538229 15597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:36999 every 8 connection(s)
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:04.549669 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.538935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:33507 (local address 127.25.227.62:35615)
0811 11:07:04.538999 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.539002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.539431 (+ 429us) server_negotiation.cc:407] Connection header received
0811 11:07:04.540086 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.540088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.540101 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.540131 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:04.541092 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.541925 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.543331 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.543602 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.543639 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.546500 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:04.546502 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:04.546502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:04.546510 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:04.548138 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:04.548607 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:04.548608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:04.548608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:04.548678 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:04.548938 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:04.548939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:04.548939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:04.549060 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:04.549100 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.549477 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.549561 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 11:07:04.550361 15600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.538905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35615 (local address 127.25.227.3:33507)
0811 11:07:04.539307 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.539351 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.539973 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.540317 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.540322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.540690 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:04.540985 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.540992 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.542039 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.542040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.543232 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.543235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.543812 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.543813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.544010 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.544730 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:04.544742 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:04.546398 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:04.548228 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:04.548234 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:04.548237 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:04.548514 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:04.548746 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:04.548747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:04.548747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:04.548874 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:04.549141 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:04.549146 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:04.549325 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.549970 (+ 645us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.550132 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":106,"threads_started":1}
I20260811 11:07:04.551056 15598 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35615
I20260811 11:07:04.551151 15598 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:04.551342 15598 heartbeater.cc:511] Master 127.25.227.62:35615 requested a full tablet report, sending...
I20260811 11:07:04.551803 14626 ts_manager.cc:194] Registered new tserver with Master: 9517c917b77844a1a4da3dc34523939f (127.25.227.3:36999)
I20260811 11:07:04.552326 14626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:33507
I20260811 11:07:04.555486 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:07:04.565791 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.557558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47640 (local address 127.25.227.62:35615)
0811 11:07:04.557609 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.557611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.557880 (+ 269us) server_negotiation.cc:407] Connection header received
0811 11:07:04.557975 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.557976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.557987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.558016 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:04.558829 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.559549 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.560647 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.560942 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.560983 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.562600 (+ 1617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:04.562601 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:04.562602 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:04.562610 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:04.564438 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:04.564861 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:04.564863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:04.564863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:04.564927 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:04.565136 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:04.565137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:04.565137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:04.565304 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:04.565389 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.565614 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.565695 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:07:04.568002 14626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:07:04.570256 14626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:07:04.580652 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.575622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:38763 (local address 127.0.0.1:44490)
0811 11:07:04.576311 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.576353 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.576441 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.576724 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.576727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.576729 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:04.576793 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.576795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.578107 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.578108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.579331 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.579334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.580361 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.580363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.580442 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.580456 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.580519 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.580571 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":912,"threads_started":1}
I20260811 11:07:04.581125 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.575847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44490 (local address 127.25.227.2:38763)
0811 11:07:04.576240 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.576245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.576405 (+ 160us) server_negotiation.cc:407] Connection header received
0811 11:07:04.576539 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.576542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.576557 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.576608 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:04.576888 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.578014 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.579455 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.580178 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.580245 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.580325 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.580997 (+ 672us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.581044 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":198,"threads_started":1}
I20260811 11:07:04.582187 15203 tablet_service.cc:1467] Processing CreateTablet for tablet ffce519462e74b22a07ead1907379b16 (DEFAULT_TABLE table=test-table [id=b58175605ef14fd0b6e0b66be6a6d4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:07:04.582593 15203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffce519462e74b22a07ead1907379b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:04.586740 15628 tablet_bootstrap.cc:492] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: Bootstrap starting.
I20260811 11:07:04.587994 15628 tablet_bootstrap.cc:654] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:04.588784 15628 log.cc:824] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:04.589993 15617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.575775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52728 (local address 127.25.227.1:44937)
0811 11:07:04.575917 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.575922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.577576 (+ 1654us) server_negotiation.cc:407] Connection header received
0811 11:07:04.577697 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.577700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.577717 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.577772 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:04.579099 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.580190 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.583557 (+ 3367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.584368 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.584420 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.584476 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.589836 (+ 5360us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.589905 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":57,"threads_started":1}
I20260811 11:07:04.590196 15628 tablet_bootstrap.cc:492] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: No bootstrap required, opened a new log
I20260811 11:07:04.590272 15628 ts_tablet_manager.cc:1397] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 11:07:04.590525 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.575626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:44937 (local address 127.0.0.1:52728)
0811 11:07:04.577499 (+ 1873us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.577509 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.577606 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.578647 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.578648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.578651 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:04.578697 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.578698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.580317 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.580317 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.583442 (+ 3125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.583446 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.586611 (+ 3165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.586611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.586684 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.586689 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.590380 (+ 3691us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.590443 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1857,"mutex_wait_us":13,"thread_start_us":591,"threads_started":1}
I20260811 11:07:04.591344 14941 tablet_service.cc:1467] Processing CreateTablet for tablet ffce519462e74b22a07ead1907379b16 (DEFAULT_TABLE table=test-table [id=b58175605ef14fd0b6e0b66be6a6d4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:07:04.591714 14941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffce519462e74b22a07ead1907379b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:04.592331 15628 raft_consensus.cc:348] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.592492 15628 raft_consensus.cc:374] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:04.592521 15628 raft_consensus.cc:729] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1598abf627db481ebd9728435d556819, State: Initialized, Role: FOLLOWER
I20260811 11:07:04.592635 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.576651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:36999 (local address 127.0.0.1:56864)
0811 11:07:04.581386 (+ 4735us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.581397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.581439 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.582071 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.582072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.582073 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:04.582104 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.582106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.587440 (+ 5334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.587441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.588888 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.588891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.591940 (+ 3049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.591941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.592004 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.592008 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.592482 (+ 474us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.592532 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4723,"thread_start_us":78,"threads_started":1}
I20260811 11:07:04.592639 15628 consensus_queue.cc:260] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.592911 15628 ts_tablet_manager.cc:1428] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:07:04.593029 15343 heartbeater.cc:503] Master 127.25.227.62:35615 was elected leader, sending a full tablet report...
I20260811 11:07:04.593044 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.576877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56864 (local address 127.25.227.3:36999)
0811 11:07:04.581824 (+ 4947us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.581829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.581841 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:07:04.581883 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.581885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.581901 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.581987 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:04.582170 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.587325 (+ 5155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.590850 (+ 3525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.591732 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.591813 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.591901 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.592914 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.592961 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4901,"thread_start_us":80,"threads_started":1}
I20260811 11:07:04.594154 15467 tablet_service.cc:1467] Processing CreateTablet for tablet ffce519462e74b22a07ead1907379b16 (DEFAULT_TABLE table=test-table [id=b58175605ef14fd0b6e0b66be6a6d4f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:07:04.594575 15467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffce519462e74b22a07ead1907379b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:04.596065 15631 tablet_bootstrap.cc:492] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: Bootstrap starting.
I20260811 11:07:04.596906 15631 tablet_bootstrap.cc:654] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:04.597426 15631 log.cc:824] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:04.598850 15634 tablet_bootstrap.cc:492] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Bootstrap starting.
I20260811 11:07:04.599862 15631 tablet_bootstrap.cc:492] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: No bootstrap required, opened a new log
I20260811 11:07:04.600013 15631 ts_tablet_manager.cc:1397] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 11:07:04.600201 15634 tablet_bootstrap.cc:654] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:04.600916 15634 log.cc:824] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:04.601833 15634 tablet_bootstrap.cc:492] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: No bootstrap required, opened a new log
I20260811 11:07:04.601902 15634 ts_tablet_manager.cc:1397] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260811 11:07:04.603888 15634 raft_consensus.cc:348] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.604049 15634 raft_consensus.cc:374] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:04.604085 15634 raft_consensus.cc:729] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9517c917b77844a1a4da3dc34523939f, State: Initialized, Role: FOLLOWER
I20260811 11:07:04.603752 15631 raft_consensus.cc:348] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.604140 15631 raft_consensus.cc:374] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:04.604199 15631 raft_consensus.cc:729] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d94bbbf6ca4974b3a8899e3b550915, State: Initialized, Role: FOLLOWER
I20260811 11:07:04.604204 15634 consensus_queue.cc:260] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.604329 15631 consensus_queue.cc:260] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.604490 15634 ts_tablet_manager.cc:1428] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 11:07:04.604540 15598 heartbeater.cc:503] Master 127.25.227.62:35615 was elected leader, sending a full tablet report...
I20260811 11:07:04.608743 15631 ts_tablet_manager.cc:1428] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: Time spent starting tablet: real 0.009s user 0.000s sys 0.004s
I20260811 11:07:04.609056 15081 heartbeater.cc:503] Master 127.25.227.62:35615 was elected leader, sending a full tablet report...
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
W20260811 11:07:04.712666 15082 tablet.cc:2369] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:07:04.745278 15344 tablet.cc:2369] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:07:04.789497 15599 tablet.cc:2369] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:07:04.821116 15630 raft_consensus.cc:482] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:07:04.821332 15630 raft_consensus.cc:504] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.821776 15630 leader_election.cc:288] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d94bbbf6ca4974b3a8899e3b550915 (127.25.227.1:44937), 9517c917b77844a1a4da3dc34523939f (127.25.227.3:36999)
I20260811 11:07:04.826167 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.822215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:48271 (local address 127.25.227.3:36999)
0811 11:07:04.822261 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.822264 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.822423 (+ 159us) server_negotiation.cc:407] Connection header received
0811 11:07:04.822529 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.822531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.822541 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.822572 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:04.822811 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.823566 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.825113 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.825726 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.825781 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.825792 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.826044 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.826087 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:07:04.826213 15617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.822174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:55903 (local address 127.25.227.1:44937)
0811 11:07:04.822224 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.822227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.822398 (+ 171us) server_negotiation.cc:407] Connection header received
0811 11:07:04.822523 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.822525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.822535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.822567 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:04.822836 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.823590 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.825108 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.825740 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.825809 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.825818 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.826082 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.826128 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:07:04.826521 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.821970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:44937 (local address 127.25.227.2:55903)
0811 11:07:04.822318 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.822330 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.822435 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.822666 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.822667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.822670 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:04.822745 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.822747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.823707 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.823708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.825005 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.825008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.825884 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.825885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.825977 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.825994 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.826384 (+ 390us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.826430 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":34,"thread_start_us":84,"threads_started":1}
I20260811 11:07:04.827010 14980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffce519462e74b22a07ead1907379b16" candidate_uuid: "1598abf627db481ebd9728435d556819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" is_pre_election: true
I20260811 11:07:04.827209 14980 raft_consensus.cc:2454] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1598abf627db481ebd9728435d556819 in term 0.
I20260811 11:07:04.827425 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.822003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:36999 (local address 127.25.227.2:48271)
0811 11:07:04.822346 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.822358 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:04.822452 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:04.822641 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:04.822642 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:04.822643 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:04.822729 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.822732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.823706 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.823707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.824983 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:04.824987 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.825882 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.825883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:04.825958 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.825962 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:07:04.826553 (+ 591us) client_negotiation.cc:240] Negotiation successful
0811 11:07:04.826806 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":38,"thread_start_us":81,"threads_started":1}
I20260811 11:07:04.827482 15134 leader_election.cc:302] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1598abf627db481ebd9728435d556819, b8d94bbbf6ca4974b3a8899e3b550915; no voters:
I20260811 11:07:04.827786 15630 raft_consensus.cc:2781] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:07:04.827850 15630 raft_consensus.cc:482] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:07:04.827875 15630 raft_consensus.cc:3037] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:04.827983 15499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffce519462e74b22a07ead1907379b16" candidate_uuid: "1598abf627db481ebd9728435d556819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9517c917b77844a1a4da3dc34523939f" is_pre_election: true
I20260811 11:07:04.828145 15499 raft_consensus.cc:2454] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1598abf627db481ebd9728435d556819 in term 0.
I20260811 11:07:04.828840 15630 raft_consensus.cc:504] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.828994 15630 leader_election.cc:288] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [CANDIDATE]: Term 1 election: Requested vote from peers b8d94bbbf6ca4974b3a8899e3b550915 (127.25.227.1:44937), 9517c917b77844a1a4da3dc34523939f (127.25.227.3:36999)
I20260811 11:07:04.829193 15499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffce519462e74b22a07ead1907379b16" candidate_uuid: "1598abf627db481ebd9728435d556819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9517c917b77844a1a4da3dc34523939f"
I20260811 11:07:04.829241 14980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffce519462e74b22a07ead1907379b16" candidate_uuid: "1598abf627db481ebd9728435d556819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d94bbbf6ca4974b3a8899e3b550915"
I20260811 11:07:04.829272 15499 raft_consensus.cc:3037] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:04.829321 14980 raft_consensus.cc:3037] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:04.830197 15499 raft_consensus.cc:2454] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1598abf627db481ebd9728435d556819 in term 1.
I20260811 11:07:04.830255 14980 raft_consensus.cc:2454] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1598abf627db481ebd9728435d556819 in term 1.
I20260811 11:07:04.830471 15134 leader_election.cc:302] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1598abf627db481ebd9728435d556819, b8d94bbbf6ca4974b3a8899e3b550915; no voters:
I20260811 11:07:04.830552 15630 raft_consensus.cc:2781] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:07:04.830714 15630 raft_consensus.cc:686] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 1 LEADER]: Becoming Leader. State: Replica: 1598abf627db481ebd9728435d556819, State: Running, Role: LEADER
I20260811 11:07:04.830806 15630 consensus_queue.cc:237] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } }
I20260811 11:07:04.831781 14626 catalog_manager.cc:5495] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1598abf627db481ebd9728435d556819 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "1598abf627db481ebd9728435d556819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1598abf627db481ebd9728435d556819" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 38763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260811 11:07:04.869119 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.865836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44494 (local address 127.25.227.2:38763)
0811 11:07:04.865902 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:04.865904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:04.865916 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:07:04.865964 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:04.865965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:04.865994 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:04.866104 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:07:04.866279 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.866774 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.867848 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:04.868137 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:04.868210 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:04.868438 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:07:04.868580 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:07:04.868664 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:04.868986 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 11:07:04.869012 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:07:04.871464 15499 raft_consensus.cc:1261] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 1 FOLLOWER]: Refusing update from remote peer 1598abf627db481ebd9728435d556819: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:07:04.871930 15630 consensus_queue.cc:1035] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9517c917b77844a1a4da3dc34523939f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:07:04.872745 14980 raft_consensus.cc:1261] T ffce519462e74b22a07ead1907379b16 P b8d94bbbf6ca4974b3a8899e3b550915 [term 1 FOLLOWER]: Refusing update from remote peer 1598abf627db481ebd9728435d556819: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:07:04.873116 15643 consensus_queue.cc:1035] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d94bbbf6ca4974b3a8899e3b550915" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 44937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:07:04.879843 15657 mvcc.cc:205] Tried to move back new op lower bound from 7317284556270399488 to 7317284556107587584. Current Snapshot: MvccSnapshot[applied={T|T < 7317284556270399488}]
I20260811 11:07:04.880151 15658 mvcc.cc:205] Tried to move back new op lower bound from 7317284556270399488 to 7317284556107587584. Current Snapshot: MvccSnapshot[applied={T|T < 7317284556270399488}]
I20260811 11:07:04.884544 14626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:07:04.884656 14626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:07:04.885447 14626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 82d6d05445ac428488569d25a7388fe3: Sending DeleteTablet for 3 replicas of tablet ffce519462e74b22a07ead1907379b16
I20260811 11:07:04.885828 14941 tablet_service.cc:1514] Processing DeleteTablet for tablet ffce519462e74b22a07ead1907379b16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:07:04 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:52728
I20260811 11:07:04.886291 15467 tablet_service.cc:1514] Processing DeleteTablet for tablet ffce519462e74b22a07ead1907379b16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:07:04 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:56864
I20260811 11:07:04.886603 15203 tablet_service.cc:1514] Processing DeleteTablet for tablet ffce519462e74b22a07ead1907379b16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:07:04 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:44490
I20260811 11:07:04.887158 15662 mvcc.cc:205] Tried to move back new op lower bound from 7317284556270399488 to 7317284556107587584. Current Snapshot: MvccSnapshot[applied={T|T < 7317284556270399488}]
I20260811 11:07:04.887230 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 14788
Aug 11 11:07:04 dist-test-slave-z8x9 krb5kdc[13707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446424, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:04.887328 15676 tablet_replica.cc:330] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: stopping tablet replica
I20260811 11:07:04.942508 15676 raft_consensus.cc:2229] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:07:04.942687 15676 raft_consensus.cc:2258] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:07:04.949446 15676 ts_tablet_manager.cc:1905] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:07:04.951316 15676 ts_tablet_manager.cc:1918] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:07:04.951419 15676 log.cc:1196] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/ffce519462e74b22a07ead1907379b16
I20260811 11:07:04.952096 15676 ts_tablet_manager.cc:1939] T ffce519462e74b22a07ead1907379b16 P 9517c917b77844a1a4da3dc34523939f: Deleting consensus metadata
W20260811 11:07:04.952756 14601 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:44937 (error 108)
I20260811 11:07:04.952816 14603 catalog_manager.cc:4841] TS 9517c917b77844a1a4da3dc34523939f (127.25.227.3:36999): tablet ffce519462e74b22a07ead1907379b16 (table test-table [id=b58175605ef14fd0b6e0b66be6a6d4f8]) successfully deleted
I20260811 11:07:04.953053 15677 tablet_replica.cc:330] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819: stopping tablet replica
I20260811 11:07:04.953235 15677 raft_consensus.cc:2229] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:07:04.953385 15677 raft_consensus.cc:2258] T ffce519462e74b22a07ead1907379b16 P 1598abf627db481ebd9728435d556819 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:07:04.953425 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 15091
I20260811 11:07:04.966508 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.966311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:44937 (local address 127.0.0.1:52744)
0811 11:07:04.966386 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.966456 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:44937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 11:07:04.966701 14601 catalog_manager.cc:4584] TS b8d94bbbf6ca4974b3a8899e3b550915 (127.25.227.1:44937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffce519462e74b22a07ead1907379b16: Network error: Client connection negotiation failed: client connection to 127.25.227.1:44937: connect: Connection refused (error 111)
I20260811 11:07:04.972170 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 15349
I20260811 11:07:04.978992 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:04.972403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:38763 (local address 127.0.0.1:44498)
0811 11:07:04.978894 (+ 6491us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:04.978949 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.2:38763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6461}
I20260811 11:07:04.993533 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 14568
I20260811 11:07:05.020377 26508 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 11:07:05.377063 26508 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 11:07:05.377247 26508 mini_ranger.cc:66] Stopping Ranger...
I20260811 11:07:05.723057 26508 mini_ranger.cc:68] Stopped Ranger
2026-08-11 11:07:05.723 UTC [13774] LOG: received smart shutdown request
2026-08-11 11:07:05.727 UTC [13774] LOG: background worker "logical replication launcher" (PID 13790) exited with exit code 1
2026-08-11 11:07:05.727 UTC [13780] LOG: shutting down
2026-08-11 11:07:05.882 UTC [13774] LOG: database system is shut down
2026-08-11T11:07:05Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47699 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:07:06 dist-test-slave-z8x9 krb5kdc[15691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:07:06 dist-test-slave-z8x9 krb5kdc[15691](info): set up 2 sockets
Aug 11 11:07:06 dist-test-slave-z8x9 krb5kdc[15691](info): commencing operation
krb5kdc: starting...
W20260811 11:07:07.296859 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:07:07 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:07:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:07:07Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/rangeradmin_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/rangeradmin_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/rangerlookup_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/rangerlookup_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
I20260811 11:07:07.468173 26508 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgatKIY/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/postgres -l logfile start
2026-08-11 11:07:09.829 UTC [15747] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 11:07:09.829 UTC [15747] LOG: listening on IPv4 address "127.25.227.20", port 44389
2026-08-11 11:07:09.832 UTC [15747] LOG: listening on Unix socket "/tmp/.s.PGSQL.44389"
2026-08-11 11:07:09.854 UTC [15752] LOG: database system was shut down at 2026-08-11 11:07:08 UTC
2026-08-11 11:07:09.858 UTC [15747] LOG: database system is ready to accept connections
I20260811 11:07:11.057880 26508 mini_postgres.cc:96] Postgres bound to 44389
2026-08-11 11:07:11.065 UTC [15765] FATAL: database "slave" does not exist
127.25.227.20:44389 - accepting connections
I20260811 11:07:11.066023 26508 mini_ranger.cc:161] Starting Ranger...
I20260811 11:07:11.081548 26508 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 11:07:11.512782 26508 mini_ranger.cc:87] Created ranger Postgres database
I20260811 11:07:11.512873 26508 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-admin
2026-08-11 11:07:11,807 [I] DB FLAVOR :POSTGRES
2026-08-11 11:07:11,807 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:07:11,807 [I] Checking connection..
2026-08-11 11:07:11,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 11:07:12,059 [I] Checking connection passed.
2026-08-11 11:07:12,060 [I] --------- Verifying version history table ---------
2026-08-11 11:07:12,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:07:12,324 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:07:12,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:07:12,579 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 11:07:12,579 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 11:07:12,579 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 11:07:12.842 UTC [15885] WARNING: there is no transaction in progress
2026-08-11 11:07:12,849 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 11:07:12,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 11:07:13,096 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 11:07:13,097 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:07:13,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 11:07:13,339 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 11:07:13,591 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-z8x9.c.gcp-upstream.internal','N') ;"
2026-08-11 11:07:13,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:07:14,082 [I] Table x_portal_user does not exist in database ranger
2026-08-11 11:07:14,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:07:14,353 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 11:07:14,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:07:14,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:07:14,878 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 11:07:14,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 11:07:15.829 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.844 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.862 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.879 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.896 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.914 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.973 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.981 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:15.996 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.006 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.016 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.029 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.039 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.045 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.052 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16.059 UTC [16091] WARNING: there is no transaction in progress
2026-08-11 11:07:16,676 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 11:07:16,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 11:07:16,947 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 11:07:16,947 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 11:07:17,209 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 11:07:17,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 11:07:17,472 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 11:07:17,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 11:07:17,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 11:07:18,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-z8x9.c.gcp-upstream.internal';"
2026-08-11 11:07:18,263 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 11:07:18,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 11:07:18,507 [I] DB_PATCHES have already been applied
I20260811 11:07:18.513271 26508 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgatKIY/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 11:07:18.513355 26508 mini_ranger.cc:193] Using host: 127.25.227.20
I20260811 11:07:18.517341 26508 mini_ranger.cc:227] Ranger admin URL: http://127.25.227.20:39981
Aug 11, 2026 11:07:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:07:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:07:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 11:07:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 11:07:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 11:07:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 11:07:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 11:07:19.960340 26508 mini_ranger.cc:160] Time spent starting Ranger: real 8.894s user 0.009s sys 0.001s
Aug 11, 2026 11:07:40 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 11:07:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 11:07:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 11:07:40 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 11:07:41 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 11:07:42.221191 26508 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.25.227.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.25.227.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/rangerkms_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.25.227.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/rangerkms_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.25.227.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.25.227.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.25.227.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/HTTP_127.25.227.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 11:07:42 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446462, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 11:07:42.313493 26508 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 11:07:42.323652 26508 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 11:07:43.101317 26508 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 11:07:43.101409 26508 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms
I20260811 11:07:43.101428 26508 mini_ranger_kms.cc:227] Using postgres at 127.25.227.20:44389
2026-08-11 11:07:43,278 [I] DB FLAVOR :POSTGRES
2026-08-11 11:07:43,279 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 11:07:43,279 [I] Checking connection
2026-08-11 11:07:43,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 11:07:43,535 [I] connection success
2026-08-11 11:07:43,535 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 11:07:43,536 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 11:07:43,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 11:07:43,777 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 11:07:43,778 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 11:07:43,778 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 11:07:43,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.25.227.20:44389/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 11:07:44,059 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 11:07:44.518193 26508 mini_ranger_kms.cc:310] Created kms service
I20260811 11:07:44.696113 26508 mini_ranger_kms.cc:326] Created kudu user
I20260811 11:07:44.743491 26508 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 11:07:44 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446462, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:45.159937 26508 mini_ranger_kms.cc:384] Added ranger policy
I20260811 11:07:45.160058 26508 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgatKIY/build/release/bin/postgresql.jar:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgatKIY/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 11:07:45.160079 26508 mini_ranger_kms.cc:240] Using host: 127.25.227.20
I20260811 11:07:45.165256 26508 mini_ranger_kms.cc:276] Ranger KMS PID: 16440
I20260811 11:07:45.165346 26508 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.25.227.20:38951
Aug 11, 2026 11:07:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 11:07:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 11:07:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 11:07:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 11:07:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 11:07:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 11:07:47 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786446467, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.227.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 11:07:47 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446467, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.227.20@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:48.026968 26508 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.713s user 0.005s sys 0.155s
I20260811 11:07:48.027071 26508 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 11:07:48.027115 26508 mini_ranger_kms.cc:401] 127.25.227.20:38951/kms/v1/keys
Aug 11 11:07:48 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446467, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.25.227.20@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
Aug 11 11:07:50 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:07:50.638139 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41459
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41459
--ranger_config_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:50.725371 16524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:50.725612 16524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:50.725646 16524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:50.726807 16524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:07:50.726874 16524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:50.726903 16524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:50.726933 16524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:07:50.726962 16524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:07:50.728600 16524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
--ranger_kms_url=127.25.227.20:38951/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41459
--ranger_config_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:50.728873 16524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:50.729094 16524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:07:50.735334 16524 server_base.cc:1034] running on GCE node
W20260811 11:07:50.735342 16535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:50.735491 16534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:50.735625 16537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:50.735900 16524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:50.736227 16524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:50.737423 16524 hybrid_clock.cc:648] HybridClock initialized: now 1786446470737399 us; error 40 us; skew 500 ppm
Aug 11 11:07:50 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446470, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:50.740360 16524 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:07:50.740901 16524 webserver.cc:460] Webserver started at http://127.25.227.62:46169/ using document root <none> and password file <none>
I20260811 11:07:50.741147 16524 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:50.741251 16524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:50.741403 16524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:50 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446470, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:50.790166 16524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "af369b654a2f49228008ec6090c72ec6"
format_stamp: "Formatted at 2026-08-11 11:07:50 on dist-test-slave-z8x9"
server_key: "e32fac0a21d233b7aaad6c255fd1376d"
server_key_iv: "d7a3d266c5fdb0978d1efda73f623c6f"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:50.790581 16524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "af369b654a2f49228008ec6090c72ec6"
format_stamp: "Formatted at 2026-08-11 11:07:50 on dist-test-slave-z8x9"
server_key: "e32fac0a21d233b7aaad6c255fd1376d"
server_key_iv: "d7a3d266c5fdb0978d1efda73f623c6f"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:50.792053 16524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:07:50.807054 16553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:50.807381 16524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:07:50.807515 16524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "af369b654a2f49228008ec6090c72ec6"
format_stamp: "Formatted at 2026-08-11 11:07:50 on dist-test-slave-z8x9"
server_key: "e32fac0a21d233b7aaad6c255fd1376d"
server_key_iv: "d7a3d266c5fdb0978d1efda73f623c6f"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:50.807623 16524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:50.815994 16524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:50.818173 16524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:50.818336 16524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:50.823175 16524 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:41459
I20260811 11:07:50.823259 16640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:41459 every 8 connection(s)
I20260811 11:07:50.823628 16524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:07:50.824374 16642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:50.824862 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 16524
I20260811 11:07:50.824985 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:07:50.825222 26508 external_mini_cluster.cc:1428] Setting key c90586200bf8199d8087460f75fb1d47
I20260811 11:07:50.827512 16642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Bootstrap starting.
I20260811 11:07:50.828150 16642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:50.828447 16642 log.cc:824] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:50.829152 16642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: No bootstrap required, opened a new log
I20260811 11:07:50.831604 16642 raft_consensus.cc:348] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:50.831794 16642 raft_consensus.cc:374] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:50.831836 16642 raft_consensus.cc:729] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af369b654a2f49228008ec6090c72ec6, State: Initialized, Role: FOLLOWER
I20260811 11:07:50.832016 16642 consensus_queue.cc:260] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:50.832118 16642 raft_consensus.cc:388] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:07:50.832185 16642 raft_consensus.cc:482] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:07:50.832245 16642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:50.832988 16642 raft_consensus.cc:504] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:50.833109 16642 leader_election.cc:302] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af369b654a2f49228008ec6090c72ec6; no voters:
I20260811 11:07:50.833344 16642 leader_election.cc:288] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 11 11:07:50 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:50.833372 16648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:07:50.833643 16648 raft_consensus.cc:686] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 LEADER]: Becoming Leader. State: Replica: af369b654a2f49228008ec6090c72ec6, State: Running, Role: LEADER
I20260811 11:07:50.833763 16642 sys_catalog.cc:564] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:07:50.833789 16648 consensus_queue.cc:237] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:50.834254 16648 sys_catalog.cc:455] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af369b654a2f49228008ec6090c72ec6. Latest consensus state: current_term: 1 leader_uuid: "af369b654a2f49228008ec6090c72ec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } } }
I20260811 11:07:50.834337 16648 sys_catalog.cc:458] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:50.834277 16652 sys_catalog.cc:455] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af369b654a2f49228008ec6090c72ec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } } }
I20260811 11:07:50.834532 16652 sys_catalog.cc:458] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:50.834857 16661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:07:50.835417 16661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:07:50.835750 16642 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 11:07:50.839725 16679 mvcc.cc:205] Tried to move back new op lower bound from 7317284744545693696 to 7317284744535826432. Current Snapshot: MvccSnapshot[applied={T|T < 7317284744545693696}]
I20260811 11:07:50.841148 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:50.825811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41464 (local address 127.25.227.62:41459)
0811 11:07:50.825994 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:50.826005 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:50.826086 (+ 81us) server_negotiation.cc:407] Connection header received
0811 11:07:50.826655 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:50.826664 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:50.826728 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:50.826896 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:50.827709 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:50.829150 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:50.830245 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:50.830853 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:50.830965 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:50.833975 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:50.833980 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:50.833980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:50.833994 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:50.836448 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:50.836886 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:50.836889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:50.836889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:50.838592 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:50.838962 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:50.838963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:50.838964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:50.839843 (+ 879us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:50.840257 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:50.840366 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 11:07:50.840806 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260811 11:07:50.843287 16661 catalog_manager.cc:1347] Generated new cluster ID: afd367d64afa456e8610843e8979c42c
I20260811 11:07:50.843346 16661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:07:50.865868 16661 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:07:50.866657 16661 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:07:50.869621 16661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Generated new TSK 0
I20260811 11:07:50.869879 16661 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:07:51.572751 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41459
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:51.694682 16714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:51.695050 16714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:51.695137 16714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:51.697261 16714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:51.697386 16714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:51.697481 16714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:07:51.700146 16714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.25.227.20:38951/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:51.700428 16714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:51.700786 16714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:51.711052 16722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:51.711174 16726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:51.711478 16714 server_base.cc:1034] running on GCE node
W20260811 11:07:51.711459 16721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:51.711802 16714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:51.712077 16714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:51.713225 16714 hybrid_clock.cc:648] HybridClock initialized: now 1786446471713213 us; error 27 us; skew 500 ppm
Aug 11 11:07:51 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:51.716178 16714 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:07:51.716601 16714 webserver.cc:460] Webserver started at http://127.25.227.1:38861/ using document root <none> and password file <none>
I20260811 11:07:51.717109 16714 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:51.717262 16714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:51.717469 16714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:51 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:51.733069 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "aca08f2827914d10a86b0a0b709ede1a"
format_stamp: "Formatted at 2026-08-11 11:07:51 on dist-test-slave-z8x9"
server_key: "ab11d6c5cd441ee52a1b3e037935a972"
server_key_iv: "34aa2f2eb3a1e1464f1d3320ab8ee401"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:51.733651 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "aca08f2827914d10a86b0a0b709ede1a"
format_stamp: "Formatted at 2026-08-11 11:07:51 on dist-test-slave-z8x9"
server_key: "ab11d6c5cd441ee52a1b3e037935a972"
server_key_iv: "34aa2f2eb3a1e1464f1d3320ab8ee401"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:51.740367 16714 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260811 11:07:51.757342 16744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:51.757612 16714 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 11:07:51.757710 16714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "aca08f2827914d10a86b0a0b709ede1a"
format_stamp: "Formatted at 2026-08-11 11:07:51 on dist-test-slave-z8x9"
server_key: "ab11d6c5cd441ee52a1b3e037935a972"
server_key_iv: "34aa2f2eb3a1e1464f1d3320ab8ee401"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:51.757807 16714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:51.783012 16714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:51.785704 16714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:51.785934 16714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:51.786278 16714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:51.786710 16714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:51.786795 16714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:51.786895 16714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:51.786967 16714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:51.794350 16714 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:38207
I20260811 11:07:51.794435 16941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:38207 every 8 connection(s)
I20260811 11:07:51.794836 16714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:07:51.798202 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 16714
I20260811 11:07:51.798310 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:07:51.798501 26508 external_mini_cluster.cc:1428] Setting key 813bfcefe76e34cf00311429531f8358
Aug 11 11:07:51 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:51.805886 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:51.795694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:37437 (local address 127.25.227.62:41459)
0811 11:07:51.795938 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:51.795940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:51.795951 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:07:51.796477 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:51.796478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:51.796494 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:51.796594 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:51.797305 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:51.798019 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:51.799730 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:51.800039 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:51.800101 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:51.802717 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:51.802719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:51.802719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:51.802727 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:51.804432 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:51.804853 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:51.804855 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:51.804855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:51.804924 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:51.805202 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:51.805204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:51.805204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:51.805334 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:51.805411 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:51.805680 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 11:07:51.805783 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":110,"threads_started":1}
I20260811 11:07:51.806049 16947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:51.795644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41459 (local address 127.25.227.1:37437)
0811 11:07:51.795816 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:51.795859 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:51.796363 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:51.796671 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:51.796674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:51.796865 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:51.797113 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:51.797129 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:51.798146 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:51.798147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:51.799635 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:51.799638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:51.800187 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:51.800188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:51.800349 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:51.800969 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:51.800980 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:51.802618 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:51.804536 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:51.804543 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:51.804546 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:51.804778 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:51.804990 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:51.804991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:51.804991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:51.805109 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:51.805401 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:51.805407 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:51.805548 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 11:07:51.805658 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 11:07:51.805804 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260811 11:07:51.806608 16942 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41459
I20260811 11:07:51.806706 16942 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:51.806893 16942 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:51.807433 16587 ts_manager.cc:194] Registered new tserver with Master: aca08f2827914d10a86b0a0b709ede1a (127.25.227.1:38207)
I20260811 11:07:51.808027 16587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:37437
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:07:51.836540 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41459
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:07:51 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 11:07:51.969143 16957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:51.969522 16957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:51.969708 16957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:51.971463 16957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:51.971698 16957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:51.971791 16957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:07:51.974114 16957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.25.227.20:38951/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:51.974581 16957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:51.974922 16957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:07:51.982769 16957 server_base.cc:1034] running on GCE node
W20260811 11:07:51.985390 16972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:51.985744 16970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:51.986502 16979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:51.986827 16957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:51.987123 16957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:51.990386 16957 hybrid_clock.cc:648] HybridClock initialized: now 1786446471990360 us; error 38 us; skew 500 ppm
Aug 11 11:07:51 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:51.993803 16957 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:07:51.994318 16957 webserver.cc:460] Webserver started at http://127.25.227.2:45439/ using document root <none> and password file <none>
I20260811 11:07:51.994561 16957 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:51.994611 16957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:51.994743 16957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:51 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:52.008725 16957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "85ff5dcd86df44e78302cb0b725de89f"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "dfc3ff7d9a96f0c4e9b9881c14160017"
server_key_iv: "a9e02d1b6c2862756acf10b26c8726f0"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.009311 16957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "85ff5dcd86df44e78302cb0b725de89f"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "dfc3ff7d9a96f0c4e9b9881c14160017"
server_key_iv: "a9e02d1b6c2862756acf10b26c8726f0"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.017549 16957 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.002s
I20260811 11:07:52.035661 16989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.035935 16957 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 11:07:52.036051 16957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "85ff5dcd86df44e78302cb0b725de89f"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "dfc3ff7d9a96f0c4e9b9881c14160017"
server_key_iv: "a9e02d1b6c2862756acf10b26c8726f0"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.036152 16957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:52.057901 16957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:52.060468 16957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:52.060704 16957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:52.060992 16957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:52.061455 16957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:52.061549 16957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.061625 16957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:52.061699 16957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.068564 16957 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:35125
I20260811 11:07:52.069330 16957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:07:52.072227 17218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:35125 every 8 connection(s)
I20260811 11:07:52.076339 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 16957
I20260811 11:07:52.076448 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:07:52.076638 26508 external_mini_cluster.cc:1428] Setting key f5e9d557b0bcdaeec393a2363e3c2a3d
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446471, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:52.088845 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:52.072954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:44565 (local address 127.25.227.62:41459)
0811 11:07:52.073016 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:52.073019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:52.073275 (+ 256us) server_negotiation.cc:407] Connection header received
0811 11:07:52.074014 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:52.074016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:52.074033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:52.074068 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:52.074956 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.075720 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.079855 (+ 4135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.080157 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.080205 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:52.085128 (+ 4923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:52.085129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:52.085130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:52.085138 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:52.087074 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:52.087600 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:52.087602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:52.087603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:52.087684 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:52.088008 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:52.088009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:52.088009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:52.088158 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:52.088219 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:52.088609 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 11:07:52.088721 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 11:07:52.089701 17222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:52.072960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41459 (local address 127.25.227.2:44565)
0811 11:07:52.073120 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:52.073183 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:52.073878 (+ 695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:52.074263 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:52.074268 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:52.074527 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:52.074832 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:52.074838 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.075844 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.075845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:52.079744 (+ 3899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:52.079748 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.080320 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.080321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:52.080466 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:52.081121 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:52.081132 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:52.084999 (+ 3867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:52.087172 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:52.087179 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:52.087183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:52.087499 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:52.087762 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:52.087763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:52.087763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:52.087916 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:52.088258 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:52.088264 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:52.088444 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 11:07:52.089268 (+ 824us) client_negotiation.cc:240] Negotiation successful
0811 11:07:52.089447 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260811 11:07:52.090390 17219 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41459
I20260811 11:07:52.090502 17219 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:52.090709 17219 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:52.091111 16587 ts_manager.cc:194] Registered new tserver with Master: 85ff5dcd86df44e78302cb0b725de89f (127.25.227.2:35125)
I20260811 11:07:52.091611 16587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:44565
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:07:52.118005 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41459
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:52.287675 17229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:52.287976 17229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:52.288017 17229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:52.289795 17229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:52.289898 17229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:52.289963 17229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:07:52.292197 17229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.25.227.20:38951/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:52.292604 17229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:52.292941 17229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:52.300052 17239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:52.300359 17236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:52.300053 17235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:52.300765 17229 server_base.cc:1034] running on GCE node
I20260811 11:07:52.300979 17229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:52.301369 17229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:52.316849 17229 hybrid_clock.cc:648] HybridClock initialized: now 1786446472316809 us; error 64 us; skew 500 ppm
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:52.320639 17229 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:07:52.321264 17229 webserver.cc:460] Webserver started at http://127.25.227.3:44093/ using document root <none> and password file <none>
I20260811 11:07:52.321569 17229 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:52.321631 17229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:52.321784 17229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:52.343544 17229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "a35b598f58f24f7bb72d42ee9fb25482"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "4aa24ffa147416b4ca8ac64f4c4f6283"
server_key_iv: "c8be762b5b2a8b67afcc4f581c94187d"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.344148 17229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "a35b598f58f24f7bb72d42ee9fb25482"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "4aa24ffa147416b4ca8ac64f4c4f6283"
server_key_iv: "c8be762b5b2a8b67afcc4f581c94187d"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.346431 17229 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 11:07:52.366585 17251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.366873 17229 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.000s
I20260811 11:07:52.366977 17229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "a35b598f58f24f7bb72d42ee9fb25482"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "4aa24ffa147416b4ca8ac64f4c4f6283"
server_key_iv: "c8be762b5b2a8b67afcc4f581c94187d"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.367084 17229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:52.393481 17229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:52.396278 17229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:52.396528 17229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:52.396850 17229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:52.397397 17229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:52.397495 17229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.397576 17229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:52.397641 17229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.404650 17229 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:41785
I20260811 11:07:52.405413 17229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:07:52.407632 17462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:41785 every 8 connection(s)
I20260811 11:07:52.409049 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 17229
I20260811 11:07:52.409161 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:07:52.409394 26508 external_mini_cluster.cc:1428] Setting key 608865d03e5e3c9ee0a0ec65666548a9
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:52.419667 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:52.408395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:49013 (local address 127.25.227.62:41459)
0811 11:07:52.408446 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:52.408448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:52.408677 (+ 229us) server_negotiation.cc:407] Connection header received
0811 11:07:52.409429 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:52.409431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:52.409445 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:52.409479 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:52.410362 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.411181 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.412737 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.413029 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.413105 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:52.415918 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:52.415920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:52.415920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:52.415928 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:52.417904 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:52.418455 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:52.418456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:52.418457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:52.418526 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:52.418846 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:52.418847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:52.418847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:52.418994 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:52.419046 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:52.419470 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 11:07:52.419564 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:07:52.420583 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:52.408346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41459 (local address 127.25.227.3:49013)
0811 11:07:52.408529 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:52.408583 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:52.409294 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:52.409671 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:52.409675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:52.409929 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:52.410241 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:52.410247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.411336 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.411337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:52.412644 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:52.412647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.413151 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.413152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:52.413333 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:52.413973 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:52.413984 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:52.415789 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:52.418009 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:52.418017 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:52.418020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:52.418356 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:52.418609 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:52.418610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:52.418610 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:52.418758 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:52.419099 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:52.419105 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:52.419292 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 11:07:52.420143 (+ 851us) client_negotiation.cc:240] Negotiation successful
0811 11:07:52.420331 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260811 11:07:52.421295 17464 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41459
I20260811 11:07:52.421396 17464 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:52.421593 17464 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:52.422029 16587 ts_manager.cc:194] Registered new tserver with Master: a35b598f58f24f7bb72d42ee9fb25482 (127.25.227.3:41785)
I20260811 11:07:52.422540 16587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:49013
I20260811 11:07:52.431972 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:07:52.432770 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 16714
I20260811 11:07:52.446681 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 16957
I20260811 11:07:52.461889 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 17229
I20260811 11:07:52.470697 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 16524
I20260811 11:07:52.496058 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41459
--webserver_interface=127.25.227.62
--webserver_port=46169
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41459
--ranger_config_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:52.587368 17467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:52.587574 17467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:52.587597 17467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:52.588721 17467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:07:52.588764 17467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:52.588778 17467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:52.588816 17467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:07:52.588850 17467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:07:52.590438 17467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41459
--ranger_config_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=46169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:52.590691 17467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:52.590916 17467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:52.595839 17478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:52.595824 17479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:52.596089 17467 server_base.cc:1034] running on GCE node
W20260811 11:07:52.595877 17487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:52.596426 17467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:52.596721 17467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:52.597887 17467 hybrid_clock.cc:648] HybridClock initialized: now 1786446472597865 us; error 33 us; skew 500 ppm
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:52.600365 17467 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:07:52.600783 17467 webserver.cc:460] Webserver started at http://127.25.227.62:46169/ using document root <none> and password file <none>
I20260811 11:07:52.601002 17467 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:52.601076 17467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:52.672561 17467 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:07:52.673408 17504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.673599 17467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:07:52.673712 17467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "af369b654a2f49228008ec6090c72ec6"
format_stamp: "Formatted at 2026-08-11 11:07:50 on dist-test-slave-z8x9"
server_key: "e32fac0a21d233b7aaad6c255fd1376d"
server_key_iv: "d7a3d266c5fdb0978d1efda73f623c6f"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.674077 17467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:52.699146 17467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:52.700829 17467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:52.700994 17467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:52.705312 17467 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:41459
I20260811 11:07:52.705360 17608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:41459 every 8 connection(s)
I20260811 11:07:52.705717 17467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:07:52.706928 17611 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:07:52.707593 17611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Bootstrap starting.
I20260811 11:07:52.713505 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 17467
I20260811 11:07:52.713881 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:38207
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:41459
--webserver_port=38861
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:07:52.716246 17611 log.cc:824] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:52.718263 17611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:07:52.718564 17611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Bootstrap complete.
I20260811 11:07:52.721048 17611 raft_consensus.cc:348] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:52.721349 17611 raft_consensus.cc:729] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af369b654a2f49228008ec6090c72ec6, State: Initialized, Role: FOLLOWER
I20260811 11:07:52.721522 17611 consensus_queue.cc:260] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:52.721588 17611 raft_consensus.cc:388] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:07:52.721644 17611 raft_consensus.cc:482] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:07:52.721692 17611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:07:52.722688 17611 raft_consensus.cc:504] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:52.722805 17611 leader_election.cc:302] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af369b654a2f49228008ec6090c72ec6; no voters:
I20260811 11:07:52.722997 17611 leader_election.cc:288] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:07:52.723034 17615 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:07:52.723196 17615 raft_consensus.cc:686] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [term 2 LEADER]: Becoming Leader. State: Replica: af369b654a2f49228008ec6090c72ec6, State: Running, Role: LEADER
I20260811 11:07:52.723299 17611 sys_catalog.cc:564] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:07:52.723361 17615 consensus_queue.cc:237] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } }
I20260811 11:07:52.723667 17615 sys_catalog.cc:455] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af369b654a2f49228008ec6090c72ec6. Latest consensus state: current_term: 2 leader_uuid: "af369b654a2f49228008ec6090c72ec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } } }
I20260811 11:07:52.723794 17615 sys_catalog.cc:458] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:52.723675 17618 sys_catalog.cc:455] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "af369b654a2f49228008ec6090c72ec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af369b654a2f49228008ec6090c72ec6" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41459 } } }
I20260811 11:07:52.723963 17618 sys_catalog.cc:458] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6 [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:52.724052 17627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:07:52.724593 17627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:07:52.724814 17627 catalog_manager.cc:1259] Loaded cluster ID: afd367d64afa456e8610843e8979c42c
I20260811 11:07:52.724906 17627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:07:52.724984 17611 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 11:07:52.726212 17627 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:07:52.726393 17627 catalog_manager.cc:5879] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Loaded TSK: 0
I20260811 11:07:52.726599 17627 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:07:52.804891 17613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:52.805276 17613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:52.805387 17613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:52.807170 17613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:52.807286 17613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:52.807394 17613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:07:52.809713 17613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:38207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=38861
--tserver_master_addrs=127.25.227.62:41459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:52.810210 17613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:52.810560 17613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:52.816977 17679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:52.817097 17680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:52.817245 17682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:52.818168 17613 server_base.cc:1034] running on GCE node
I20260811 11:07:52.818405 17613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:52.818692 17613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:52.819883 17613 hybrid_clock.cc:648] HybridClock initialized: now 1786446472819836 us; error 43 us; skew 500 ppm
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:52.823311 17613 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:07:52.823794 17613 webserver.cc:460] Webserver started at http://127.25.227.1:38861/ using document root <none> and password file <none>
I20260811 11:07:52.824072 17613 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:52.824143 17613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:52.849947 17613 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:07:52.851066 17694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.851320 17613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:07:52.851421 17613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "aca08f2827914d10a86b0a0b709ede1a"
format_stamp: "Formatted at 2026-08-11 11:07:51 on dist-test-slave-z8x9"
server_key: "ab11d6c5cd441ee52a1b3e037935a972"
server_key_iv: "34aa2f2eb3a1e1464f1d3320ab8ee401"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:52.851801 17613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:52.871995 17613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:52.874915 17613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:52.875155 17613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:52.875483 17613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:52.875952 17613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:52.876052 17613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.876127 17613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:52.876180 17613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:52.884909 17613 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:38207
I20260811 11:07:52.885480 17613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:07:52.888079 17896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:38207 every 8 connection(s)
I20260811 11:07:52.891820 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 17613
I20260811 11:07:52.892143 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:35125
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:41459
--webserver_port=45439
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:07:52 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446472, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:52.911828 17901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:52.888909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:37575 (local address 127.25.227.62:41459)
0811 11:07:52.889140 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:52.889166 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:52.889797 (+ 631us) server_negotiation.cc:407] Connection header received
0811 11:07:52.894162 (+ 4365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:52.894171 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:52.894753 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:52.894938 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:52.895775 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.897415 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.899106 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.899818 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.899908 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:52.906347 (+ 6439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:52.906353 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:52.906353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:52.906370 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:52.909117 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:52.909867 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:52.909871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:52.909872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:52.910005 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:52.910392 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:52.910394 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:52.910394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:52.910761 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:52.910850 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:52.911353 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 11:07:52.911528 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":83,"threads_started":1}
I20260811 11:07:52.913004 17900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:52.888816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41459 (local address 127.25.227.1:37575)
0811 11:07:52.889629 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:52.889669 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:52.893799 (+ 4130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:52.894991 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:52.894995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:52.895288 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:52.895602 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:52.895609 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.897567 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.897568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:52.898989 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:52.898993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:52.900089 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:52.900091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:52.900245 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:52.900881 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:52.900893 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:52.906144 (+ 5251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:52.909274 (+ 3130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:52.909282 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:52.909285 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:52.909742 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:52.910107 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:52.910108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:52.910109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:52.910289 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:52.910900 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:52.910908 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:52.911094 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 11:07:52.912497 (+ 1403us) client_negotiation.cc:240] Negotiation successful
0811 11:07:52.912707 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"thread_start_us":98,"threads_started":1}
I20260811 11:07:52.914284 17897 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41459
I20260811 11:07:52.914386 17897 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:52.914587 17897 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
W20260811 11:07:52.915514 17897 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:41459 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 11:07:52.915588 17897 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:52.915653 17897 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:52.916056 17897 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:52.916136 17897 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
W20260811 11:07:52.916488 17897 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:07:53.016746 17902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:53.016979 17902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:53.017019 17902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:53.018347 17902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:53.018440 17902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:53.018500 17902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:07:53.020226 17902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:35125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=45439
--tserver_master_addrs=127.25.227.62:41459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:53.020510 17902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:53.020752 17902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:53.027525 17912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:53.028745 17911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:53.029361 17916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:53.030289 17902 server_base.cc:1034] running on GCE node
I20260811 11:07:53.030561 17902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:53.030862 17902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:53.032040 17902 hybrid_clock.cc:648] HybridClock initialized: now 1786446473032021 us; error 34 us; skew 500 ppm
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:53.035504 17902 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:07:53.036193 17902 webserver.cc:460] Webserver started at http://127.25.227.2:45439/ using document root <none> and password file <none>
I20260811 11:07:53.036485 17902 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:53.036579 17902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:53.056658 17902 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 11:07:53.058300 17931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:53.058524 17902 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:07:53.058662 17902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "85ff5dcd86df44e78302cb0b725de89f"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "dfc3ff7d9a96f0c4e9b9881c14160017"
server_key_iv: "a9e02d1b6c2862756acf10b26c8726f0"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:53.059270 17902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:53.073566 17902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:53.076035 17902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:53.076205 17902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:53.076486 17902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:53.076866 17902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:53.076915 17902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:53.076946 17902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:53.076972 17902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:53.084430 17902 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:35125
I20260811 11:07:53.084936 17902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:07:53.087981 18129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:35125 every 8 connection(s)
I20260811 11:07:53.088539 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 17902
I20260811 11:07:53.088824 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.25.227.20:38951/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:41785
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:41459
--webserver_port=44093
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:53.097689 17901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:53.086027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:52841 (local address 127.25.227.62:41459)
0811 11:07:53.086070 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:53.086072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:53.086287 (+ 215us) server_negotiation.cc:407] Connection header received
0811 11:07:53.087007 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:53.087009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:53.087026 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:53.087058 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:53.087915 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.088767 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.090339 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.090666 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.090714 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:53.093650 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:53.093652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:53.093653 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:53.093662 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:53.095845 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:53.096406 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:53.096408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:53.096408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:53.096477 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:53.096807 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:53.096808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:53.096809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:53.096970 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:53.097051 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:53.097489 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 11:07:53.097588 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:07:53.098472 18133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:53.085736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41459 (local address 127.25.227.2:52841)
0811 11:07:53.086160 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:53.086204 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:53.086875 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:53.087246 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:53.087250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:53.087480 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:53.087796 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:53.087803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.088898 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.088899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:53.090231 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:53.090235 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.090850 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.090851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:53.091013 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:53.091637 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:53.091648 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:53.093531 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:53.095946 (+ 2415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:53.095954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:53.095958 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:53.096314 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:53.096563 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:53.096564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:53.096564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:53.096724 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:53.097058 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:53.097065 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:53.097298 (+ 233us) client_negotiation.cc:769] Sending connection context
0811 11:07:53.098021 (+ 723us) client_negotiation.cc:240] Negotiation successful
0811 11:07:53.098225 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":80,"threads_started":1}
I20260811 11:07:53.099264 18131 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41459
I20260811 11:07:53.099378 18131 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.099615 18131 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
W20260811 11:07:53.100319 18131 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:41459 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 11:07:53.100409 18131 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.100490 18131 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:53.100862 18131 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.100948 18131 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
W20260811 11:07:53.101302 18131 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:07:53.195138 18136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:53.195400 18136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:53.195432 18136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:53.196663 18136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:53.196727 18136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:53.196769 18136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:07:53.198534 18136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.25.227.20:38951/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:41785
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=44093
--tserver_master_addrs=127.25.227.62:41459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:53.198809 18136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:53.199051 18136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:53.204479 18146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:53.204778 18136 server_base.cc:1034] running on GCE node
W20260811 11:07:53.204470 18144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:53.204931 18143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:53.205217 18136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:53.205538 18136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:53.206692 18136 hybrid_clock.cc:648] HybridClock initialized: now 1786446473206681 us; error 29 us; skew 500 ppm
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:53.209515 18136 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:07:53.210047 18136 webserver.cc:460] Webserver started at http://127.25.227.3:44093/ using document root <none> and password file <none>
I20260811 11:07:53.210330 18136 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:53.210410 18136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:53.229362 18136 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:07:53.230666 18161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:53.231101 18136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:07:53.231213 18136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "a35b598f58f24f7bb72d42ee9fb25482"
format_stamp: "Formatted at 2026-08-11 11:07:52 on dist-test-slave-z8x9"
server_key: "4aa24ffa147416b4ca8ac64f4c4f6283"
server_key_iv: "c8be762b5b2a8b67afcc4f581c94187d"
server_key_version: "kuduclusterkey@0"
I20260811 11:07:53.231693 18136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:53.247900 18136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:53.250916 18136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:53.251096 18136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:53.251368 18136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:07:53.251705 18136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:07:53.251761 18136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:53.251806 18136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:07:53.251833 18136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:53.261061 18136 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:41785
I20260811 11:07:53.261116 18369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:41785 every 8 connection(s)
I20260811 11:07:53.261580 18136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:07:53.266420 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 18136
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:53.274844 17901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:53.263519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:55483 (local address 127.25.227.62:41459)
0811 11:07:53.263573 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:53.263575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:53.263958 (+ 383us) server_negotiation.cc:407] Connection header received
0811 11:07:53.264580 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:53.264581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:53.264594 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:53.264660 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:53.265337 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.265844 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.267601 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.267895 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.267963 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:53.270704 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:53.270706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:53.270707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:53.270716 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:53.272960 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:53.273583 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:53.273584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:53.273585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:53.273651 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:53.274095 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:53.274097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:53.274097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:53.274266 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:53.274324 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:53.274644 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 11:07:53.274748 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:07:53.275028 18376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:53.263506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41459 (local address 127.25.227.3:55483)
0811 11:07:53.263809 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:53.263853 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:53.264471 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:53.264735 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:53.264739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:53.264940 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:53.265221 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:53.265229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.265973 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.265974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:53.267510 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:53.267513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.268022 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.268024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:53.268179 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:53.268861 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:53.268873 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:53.270573 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:53.273064 (+ 2491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:53.273073 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:53.273076 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:53.273486 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:53.273739 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:53.273739 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:53.273740 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:53.273994 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:53.274352 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:53.274360 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:53.274498 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 11:07:53.274607 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 11:07:53.274769 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":211,"threads_started":1}
I20260811 11:07:53.275539 18371 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41459
I20260811 11:07:53.275660 18371 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.275880 18371 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
W20260811 11:07:53.276635 18371 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:41459 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 11:07:53.276705 18371 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.276731 18378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:53.266874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54772 (local address 127.25.227.62:41459)
0811 11:07:53.267846 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:53.267848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:53.267854 (+ 6us) server_negotiation.cc:407] Connection header received
0811 11:07:53.267872 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:53.267873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:53.267884 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:53.267947 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:53.268657 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.269264 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.270374 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:53.270570 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:53.270663 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:53.272080 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:53.272082 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:53.272082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:53.272089 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:53.274224 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:53.275531 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:53.275532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:53.275532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:53.275593 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:53.275817 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:53.275818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:53.275818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:53.275950 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:53.276462 (+ 512us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:53.276522 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 11:07:53.276609 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":948,"thread_start_us":202,"threads_started":1}
I20260811 11:07:53.276770 18371 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:53.277196 18371 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.277297 18371 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
W20260811 11:07:53.277705 18371 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 11:07:53 dist-test-slave-z8x9 krb5kdc[15691](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:53.916688 17897 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:53.916862 17897 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:53.917311 17535 ts_manager.cc:194] Registered new tserver with Master: aca08f2827914d10a86b0a0b709ede1a (127.25.227.1:38207)
I20260811 11:07:53.918469 17535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:37575
I20260811 11:07:54.101470 18131 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:54.101642 18131 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:54.101979 17535 ts_manager.cc:194] Registered new tserver with Master: 85ff5dcd86df44e78302cb0b725de89f (127.25.227.2:35125)
I20260811 11:07:54.102499 17535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:52841
Aug 11 11:07:54 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:54.277868 18371 heartbeater.cc:464] Registering TS with master...
I20260811 11:07:54.278029 18371 heartbeater.cc:511] Master 127.25.227.62:41459 requested a full tablet report, sending...
I20260811 11:07:54.278411 17535 ts_manager.cc:194] Registered new tserver with Master: a35b598f58f24f7bb72d42ee9fb25482 (127.25.227.3:41785)
I20260811 11:07:54.278954 17535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:55483
I20260811 11:07:54.289085 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:07:54.301309 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.290183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54786 (local address 127.25.227.62:41459)
0811 11:07:54.290453 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.290455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.293378 (+ 2923us) server_negotiation.cc:407] Connection header received
0811 11:07:54.293443 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.293444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.293459 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.293539 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:54.294208 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.294990 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.295997 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.296322 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.296385 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.298005 (+ 1620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:54.298006 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:54.298007 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:54.298015 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:54.299868 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:54.300284 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:54.300285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:54.300285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:54.300359 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:54.300584 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:54.300585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:54.300586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:54.300724 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:54.300828 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.300977 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.301069 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":192,"threads_started":1}
I20260811 11:07:54.303717 17535 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:07:54.305994 17535 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:07:54.318228 18431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.309404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:38207 (local address 127.0.0.1:48672)
0811 11:07:54.313364 (+ 3960us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:54.313375 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:54.313432 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:54.313681 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:54.313684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:54.313686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:54.313774 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.313776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.315213 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.315215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.316624 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.316627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.317880 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.317881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.317974 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.317990 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 11:07:54.318062 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 11:07:54.318121 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3941,"mutex_wait_us":4,"thread_start_us":177,"threads_started":1}
I20260811 11:07:54.318600 18429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.309567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48672 (local address 127.25.227.1:38207)
0811 11:07:54.313298 (+ 3731us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.313304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.313485 (+ 181us) server_negotiation.cc:407] Connection header received
0811 11:07:54.313525 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.313527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.313545 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.313654 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:54.313879 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.315102 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.316739 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.317674 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.317766 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.317837 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.318451 (+ 614us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.318503 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3691,"thread_start_us":72,"threads_started":1}
I20260811 11:07:54.319578 17775 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff26e12a765495aaf07d71ed892c9a6 (DEFAULT_TABLE table=test-table [id=dd2863b6223d408b94c0d9c4c22f1477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:07:54.320043 17775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff26e12a765495aaf07d71ed892c9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:54.321409 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.309941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59740 (local address 127.25.227.2:35125)
0811 11:07:54.310086 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.310091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.313837 (+ 3746us) server_negotiation.cc:407] Connection header received
0811 11:07:54.313944 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.313946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.313961 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.314011 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:54.314436 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.315758 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.319722 (+ 3964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.320651 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.320701 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.320751 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.320970 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.321010 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260811 11:07:54.321810 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.309686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35125 (local address 127.0.0.1:59740)
0811 11:07:54.313771 (+ 4085us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:54.313781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:54.313864 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:54.314108 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:54.314109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:54.314110 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:54.314165 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.314167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.315864 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.315864 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.317004 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.317006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.320816 (+ 3810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.320817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.320884 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.320888 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:07:54.321689 (+ 801us) client_negotiation.cc:240] Negotiation successful
0811 11:07:54.321737 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4069,"thread_start_us":123,"threads_started":1}
I20260811 11:07:54.324142 18005 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff26e12a765495aaf07d71ed892c9a6 (DEFAULT_TABLE table=test-table [id=dd2863b6223d408b94c0d9c4c22f1477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:07:54.324505 18005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff26e12a765495aaf07d71ed892c9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:54.325273 18423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.309404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:41785 (local address 127.0.0.1:51144)
0811 11:07:54.313297 (+ 3893us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:54.313341 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:54.313408 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:54.317239 (+ 3831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:54.317240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:54.317242 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:54.317284 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.317285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.322134 (+ 4849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.322134 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.323334 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.323337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.324992 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.324993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.325069 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.325073 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:07:54.325140 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 11:07:54.325197 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3859,"thread_start_us":109,"threads_started":1}
I20260811 11:07:54.325696 18430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.309723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.25.227.3:41785)
0811 11:07:54.314276 (+ 4553us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.314281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.314289 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:07:54.314320 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.314322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.314336 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.317368 (+ 3032us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:54.317453 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.319609 (+ 2156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.323756 (+ 4147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.324853 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.324975 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.325032 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.325566 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.325609 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4519,"thread_start_us":67,"threads_started":1}
I20260811 11:07:54.326440 18253 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff26e12a765495aaf07d71ed892c9a6 (DEFAULT_TABLE table=test-table [id=dd2863b6223d408b94c0d9c4c22f1477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:07:54.326858 18253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff26e12a765495aaf07d71ed892c9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:54.328902 18437 tablet_bootstrap.cc:492] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Bootstrap starting.
I20260811 11:07:54.329707 18437 tablet_bootstrap.cc:654] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:54.330102 18437 log.cc:824] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:54.330849 18438 tablet_bootstrap.cc:492] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Bootstrap starting.
I20260811 11:07:54.331362 18437 tablet_bootstrap.cc:492] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: No bootstrap required, opened a new log
I20260811 11:07:54.331431 18437 ts_tablet_manager.cc:1397] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:07:54.333489 18437 raft_consensus.cc:348] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.333644 18437 raft_consensus.cc:374] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:54.333673 18437 raft_consensus.cc:729] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85ff5dcd86df44e78302cb0b725de89f, State: Initialized, Role: FOLLOWER
I20260811 11:07:54.333788 18437 consensus_queue.cc:260] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.334035 18437 ts_tablet_manager.cc:1428] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:07:54.334093 18131 heartbeater.cc:503] Master 127.25.227.62:41459 was elected leader, sending a full tablet report...
I20260811 11:07:54.335533 18438 tablet_bootstrap.cc:654] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:54.335896 18438 log.cc:824] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:54.337325 18436 tablet_bootstrap.cc:492] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: Bootstrap starting.
I20260811 11:07:54.337564 18438 tablet_bootstrap.cc:492] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: No bootstrap required, opened a new log
I20260811 11:07:54.337637 18438 ts_tablet_manager.cc:1397] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 11:07:54.337949 18436 tablet_bootstrap.cc:654] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:54.338238 18436 log.cc:824] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: Log is configured to *not* fsync() on all Append() calls
W20260811 11:07:54.338896 18132 tablet.cc:2369] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:07:54.340152 18438 raft_consensus.cc:348] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.340363 18438 raft_consensus.cc:374] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:54.340410 18438 raft_consensus.cc:729] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35b598f58f24f7bb72d42ee9fb25482, State: Initialized, Role: FOLLOWER
I20260811 11:07:54.340519 18438 consensus_queue.cc:260] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.340771 18438 ts_tablet_manager.cc:1428] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:07:54.340818 18371 heartbeater.cc:503] Master 127.25.227.62:41459 was elected leader, sending a full tablet report...
I20260811 11:07:54.341223 18436 tablet_bootstrap.cc:492] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: No bootstrap required, opened a new log
I20260811 11:07:54.341298 18436 ts_tablet_manager.cc:1397] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 11:07:54.343763 18436 raft_consensus.cc:348] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.343935 18436 raft_consensus.cc:374] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:54.343976 18436 raft_consensus.cc:729] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aca08f2827914d10a86b0a0b709ede1a, State: Initialized, Role: FOLLOWER
I20260811 11:07:54.344086 18436 consensus_queue.cc:260] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.344341 18436 ts_tablet_manager.cc:1428] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:07:54.344380 17897 heartbeater.cc:503] Master 127.25.227.62:41459 was elected leader, sending a full tablet report...
W20260811 11:07:54.389616 17898 tablet.cc:2369] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:07:54.444692 18449 raft_consensus.cc:482] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:07:54.444865 18449 raft_consensus.cc:504] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.445340 18449 leader_election.cc:288] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85ff5dcd86df44e78302cb0b725de89f (127.25.227.2:35125), a35b598f58f24f7bb72d42ee9fb25482 (127.25.227.3:41785)
I20260811 11:07:54.452728 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.446080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:33357 (local address 127.25.227.2:35125)
0811 11:07:54.446174 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.446177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.446348 (+ 171us) server_negotiation.cc:407] Connection header received
0811 11:07:54.446455 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.446456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.446467 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.446497 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:54.446726 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.447469 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.451488 (+ 4019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.452310 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.452363 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.452375 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.452606 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.452650 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 11:07:54.452998 18453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.445604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:35125 (local address 127.25.227.1:33357)
0811 11:07:54.446280 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:54.446291 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:54.446377 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:54.446564 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:54.446565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:54.446567 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:54.446654 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.446656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.447583 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.447584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.448826 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.448830 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.452454 (+ 3624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.452455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.452524 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.452528 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:07:54.452857 (+ 329us) client_negotiation.cc:240] Negotiation successful
0811 11:07:54.452902 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":110,"threads_started":1}
I20260811 11:07:54.453339 18047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff26e12a765495aaf07d71ed892c9a6" candidate_uuid: "aca08f2827914d10a86b0a0b709ede1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ff5dcd86df44e78302cb0b725de89f" is_pre_election: true
I20260811 11:07:54.453514 18047 raft_consensus.cc:2454] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca08f2827914d10a86b0a0b709ede1a in term 0.
I20260811 11:07:54.453759 17700 leader_election.cc:302] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ff5dcd86df44e78302cb0b725de89f, aca08f2827914d10a86b0a0b709ede1a; no voters:
I20260811 11:07:54.453922 18449 raft_consensus.cc:2781] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:07:54.453987 18449 raft_consensus.cc:482] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:07:54.454015 18449 raft_consensus.cc:3037] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:54.454499 18430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.446125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:53325 (local address 127.25.227.3:41785)
0811 11:07:54.446207 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.446209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.449006 (+ 2797us) server_negotiation.cc:407] Connection header received
0811 11:07:54.449100 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.449101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.449111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.449138 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:07:54.449359 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.450061 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.453289 (+ 3228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.453807 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.453857 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.453867 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.454378 (+ 511us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.454426 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 11:07:54.454762 18451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.445857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:41785 (local address 127.25.227.1:53325)
0811 11:07:54.448950 (+ 3093us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:54.448960 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:54.449032 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:54.449228 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:54.449229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:54.449231 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:07:54.449290 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.449292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.450164 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.450165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.451371 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:54.451375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.454208 (+ 2833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.454208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:54.454289 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.454292 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:07:54.454636 (+ 344us) client_negotiation.cc:240] Negotiation successful
0811 11:07:54.454685 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3075,"thread_start_us":72,"threads_started":1}
I20260811 11:07:54.455155 18449 raft_consensus.cc:504] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.455363 18449 leader_election.cc:288] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [CANDIDATE]: Term 1 election: Requested vote from peers 85ff5dcd86df44e78302cb0b725de89f (127.25.227.2:35125), a35b598f58f24f7bb72d42ee9fb25482 (127.25.227.3:41785)
I20260811 11:07:54.455567 18287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff26e12a765495aaf07d71ed892c9a6" candidate_uuid: "aca08f2827914d10a86b0a0b709ede1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35b598f58f24f7bb72d42ee9fb25482" is_pre_election: true
I20260811 11:07:54.455731 18287 raft_consensus.cc:2454] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aca08f2827914d10a86b0a0b709ede1a in term 0.
I20260811 11:07:54.455981 18287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff26e12a765495aaf07d71ed892c9a6" candidate_uuid: "aca08f2827914d10a86b0a0b709ede1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35b598f58f24f7bb72d42ee9fb25482"
I20260811 11:07:54.456070 18287 raft_consensus.cc:3037] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:54.456118 18047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff26e12a765495aaf07d71ed892c9a6" candidate_uuid: "aca08f2827914d10a86b0a0b709ede1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85ff5dcd86df44e78302cb0b725de89f"
I20260811 11:07:54.456202 18047 raft_consensus.cc:3037] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:54.456995 18287 raft_consensus.cc:2454] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca08f2827914d10a86b0a0b709ede1a in term 1.
I20260811 11:07:54.457020 18047 raft_consensus.cc:2454] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aca08f2827914d10a86b0a0b709ede1a in term 1.
I20260811 11:07:54.457223 17700 leader_election.cc:302] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85ff5dcd86df44e78302cb0b725de89f, aca08f2827914d10a86b0a0b709ede1a; no voters:
I20260811 11:07:54.457315 18449 raft_consensus.cc:2781] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:07:54.457490 18449 raft_consensus.cc:686] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 1 LEADER]: Becoming Leader. State: Replica: aca08f2827914d10a86b0a0b709ede1a, State: Running, Role: LEADER
I20260811 11:07:54.457592 18449 consensus_queue.cc:237] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } }
I20260811 11:07:54.458400 17535 catalog_manager.cc:5495] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a reported cstate change: term changed from 0 to 1, leader changed from <none> to aca08f2827914d10a86b0a0b709ede1a (127.25.227.1). New cstate: current_term: 1 leader_uuid: "aca08f2827914d10a86b0a0b709ede1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aca08f2827914d10a86b0a0b709ede1a" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 38207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
Aug 11 11:07:54 dist-test-slave-z8x9 krb5kdc[15691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446473, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for HTTP/127.25.227.20@KRBTEST.COM
I20260811 11:07:54.495815 18429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.492697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48686 (local address 127.25.227.1:38207)
0811 11:07:54.492755 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:54.492757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:54.492769 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:07:54.492861 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:54.492862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:54.492885 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:54.492980 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:07:54.493207 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.493855 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.494827 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:54.495043 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:54.495124 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:54.495457 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:07:54.495561 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:07:54.495658 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:54.495701 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 11:07:54.495724 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 11:07:54.497975 18047 raft_consensus.cc:1261] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 1 FOLLOWER]: Refusing update from remote peer aca08f2827914d10a86b0a0b709ede1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:07:54.498014 18287 raft_consensus.cc:1261] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 1 FOLLOWER]: Refusing update from remote peer aca08f2827914d10a86b0a0b709ede1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:07:54.498347 18449 consensus_queue.cc:1035] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85ff5dcd86df44e78302cb0b725de89f" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 35125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:07:54.498596 18456 consensus_queue.cc:1035] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35b598f58f24f7bb72d42ee9fb25482" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:07:54.501431 18461 mvcc.cc:205] Tried to move back new op lower bound from 7317284759540850688 to 7317284759378898944. Current Snapshot: MvccSnapshot[applied={T|T < 7317284759540850688 or (T in {7317284759540850688})}]
I20260811 11:07:54.503295 18464 mvcc.cc:205] Tried to move back new op lower bound from 7317284759540850688 to 7317284759378898944. Current Snapshot: MvccSnapshot[applied={T|T < 7317284759540850688}]
I20260811 11:07:54.503724 17531 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:07:54.503822 17531 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:07:54.504484 17531 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af369b654a2f49228008ec6090c72ec6: Sending DeleteTablet for 3 replicas of tablet 1ff26e12a765495aaf07d71ed892c9a6
I20260811 11:07:54.504937 17775 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff26e12a765495aaf07d71ed892c9a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:07:54 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:48672
I20260811 11:07:54.504941 18005 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff26e12a765495aaf07d71ed892c9a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:07:54 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:59740
I20260811 11:07:54.505316 18253 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff26e12a765495aaf07d71ed892c9a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:07:54 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:51144
I20260811 11:07:54.505470 18478 tablet_replica.cc:330] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a: stopping tablet replica
I20260811 11:07:54.505609 18478 raft_consensus.cc:2229] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:07:54.505760 18478 raft_consensus.cc:2258] T 1ff26e12a765495aaf07d71ed892c9a6 P aca08f2827914d10a86b0a0b709ede1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:07:54.505905 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 17613
I20260811 11:07:54.506551 18477 tablet_replica.cc:330] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: stopping tablet replica
I20260811 11:07:54.506678 18477 raft_consensus.cc:2229] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:07:54.506765 18477 pending_rounds.cc:62] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Trying to abort 2 pending ops.
I20260811 11:07:54.506803 18477 pending_rounds.cc:68] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317284759540850688 op_type: WRITE_OP write_request { tablet_id: "1ff26e12a765495aaf07d71ed892c9a6" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\266\207\354\323\006\"8\n\ntest-admin\022*\n dd2863b6223d408b94c0d9c4c22f1477\020\001\030\001 \001(\001" signature: "<redacted>""k\355\364*\274\274\266\226\267]\235\373F\027\233xR\256\267\020\220\227[{\315\254U\237\344\254e W\3432\031n\300\344\351\3143\276\rn\023\273\261\032\354\244\316\232\257^,}\216\222\344zl\215\343" signing_key_seq_num: 0 } } request_id { client_id: "d9269cc3a91546088d4b6932d2727a42" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260811 11:07:54.507028 18477 pending_rounds.cc:68] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317284759378898944 op_type: NO_OP noop_request { }
I20260811 11:07:54.507077 18477 raft_consensus.cc:2866] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 11:07:54.507102 18477 raft_consensus.cc:2258] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:07:54.509171 18479 tablet_replica.cc:330] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: stopping tablet replica
I20260811 11:07:54.509296 18479 raft_consensus.cc:2229] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:07:54.509409 18479 raft_consensus.cc:2258] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:07:54.509650 18477 ts_tablet_manager.cc:1905] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:07:54.509873 18479 ts_tablet_manager.cc:1905] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:07:54.511579 18477 ts_tablet_manager.cc:1918] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:07:54.511579 18479 ts_tablet_manager.cc:1918] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:07:54.511657 18479 log.cc:1196] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/1ff26e12a765495aaf07d71ed892c9a6
I20260811 11:07:54.511758 18477 log.cc:1196] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/1ff26e12a765495aaf07d71ed892c9a6
I20260811 11:07:54.511977 18479 ts_tablet_manager.cc:1939] T 1ff26e12a765495aaf07d71ed892c9a6 P a35b598f58f24f7bb72d42ee9fb25482: Deleting consensus metadata
I20260811 11:07:54.512143 18477 ts_tablet_manager.cc:1939] T 1ff26e12a765495aaf07d71ed892c9a6 P 85ff5dcd86df44e78302cb0b725de89f: Deleting consensus metadata
I20260811 11:07:54.512629 17509 catalog_manager.cc:4841] TS 85ff5dcd86df44e78302cb0b725de89f (127.25.227.2:35125): tablet 1ff26e12a765495aaf07d71ed892c9a6 (table test-table [id=dd2863b6223d408b94c0d9c4c22f1477]) successfully deleted
I20260811 11:07:54.514036 17506 catalog_manager.cc:4841] TS a35b598f58f24f7bb72d42ee9fb25482 (127.25.227.3:41785): tablet 1ff26e12a765495aaf07d71ed892c9a6 (table test-table [id=dd2863b6223d408b94c0d9c4c22f1477]) successfully deleted
W20260811 11:07:54.525831 17933 connection.cc:535] server connection from 127.25.227.1:33357 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 11:07:54.526139 17509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:38207 (error 108)
I20260811 11:07:54.526697 18423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:54.526554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:38207 (local address 127.0.0.1:48694)
0811 11:07:54.526613 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:54.526654 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:38207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 11:07:54.526973 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 17902
W20260811 11:07:54.526970 17509 catalog_manager.cc:4584] TS aca08f2827914d10a86b0a0b709ede1a (127.25.227.1:38207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1ff26e12a765495aaf07d71ed892c9a6: Network error: Client connection negotiation failed: client connection to 127.25.227.1:38207: connect: Connection refused (error 111)
I20260811 11:07:54.550748 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 18136
I20260811 11:07:54.563005 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 17467
I20260811 11:07:54.583611 26508 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 11:07:54.938344 26508 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 11:07:54.938441 26508 mini_ranger.cc:66] Stopping Ranger...
I20260811 11:07:55.293023 26508 mini_ranger.cc:68] Stopped Ranger
2026-08-11 11:07:55.293 UTC [15747] LOG: received smart shutdown request
2026-08-11 11:07:55.297 UTC [15747] LOG: background worker "logical replication launcher" (PID 15759) exited with exit code 1
2026-08-11 11:07:55.297 UTC [15753] LOG: shutting down
2026-08-11 11:07:55.459 UTC [15747] LOG: database system is shut down
2026-08-11T11:07:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49591 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:07:55 dist-test-slave-z8x9 krb5kdc[18501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:07:55 dist-test-slave-z8x9 krb5kdc[18501](info): set up 2 sockets
Aug 11 11:07:55 dist-test-slave-z8x9 krb5kdc[18501](info): commencing operation
krb5kdc: starting...
W20260811 11:07:56.904594 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.295s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:07:56 dist-test-slave-z8x9 krb5kdc[18501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:07:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:07:57.029546 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:39929
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:39929,127.25.227.61:35941,127.25.227.60:43679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:07:57.113694 18526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:57.113945 18526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:57.113983 18526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:57.115103 18526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:07:57.115170 18526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:57.115195 18526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:57.115228 18526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:07:57.115278 18526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:07:57.116796 18526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:39929,127.25.227.61:35941,127.25.227.60:43679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:39929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:57.117063 18526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:57.117331 18526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:57.122121 18540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:57.122334 18526 server_base.cc:1034] running on GCE node
W20260811 11:07:57.122114 18542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:57.122114 18539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:57.122675 18526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:57.122958 18526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:57.124099 18526 hybrid_clock.cc:648] HybridClock initialized: now 1786446477124086 us; error 27 us; skew 500 ppm
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:57.130081 18526 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:07:57.130476 18526 webserver.cc:460] Webserver started at http://127.25.227.62:43443/ using document root <none> and password file <none>
I20260811 11:07:57.130659 18526 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:57.130698 18526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:57.130805 18526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:07:57.131794 18526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "1823bf8e475349b7af071376b1f052ba"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "d5f83025b7f643f67f70e44d3c9f4577"
server_key_iv: "c2113f9e46a61b72cf2a1eeaf6409803"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.132099 18526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "1823bf8e475349b7af071376b1f052ba"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "d5f83025b7f643f67f70e44d3c9f4577"
server_key_iv: "c2113f9e46a61b72cf2a1eeaf6409803"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.133424 18526 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:07:57.134191 18553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:57.134402 18526 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:07:57.134498 18526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "1823bf8e475349b7af071376b1f052ba"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "d5f83025b7f643f67f70e44d3c9f4577"
server_key_iv: "c2113f9e46a61b72cf2a1eeaf6409803"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.134575 18526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:57.155026 18526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:57.157066 18526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:57.157215 18526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:57.161635 18526 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:39929
I20260811 11:07:57.161706 18654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:39929 every 8 connection(s)
I20260811 11:07:57.162048 18526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:07:57.163048 18656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:57.164343 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 18526
I20260811 11:07:57.164465 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:07:57.164695 26508 external_mini_cluster.cc:1428] Setting key ffd21a0f9ddc69dc555ace6716b56f5d
I20260811 11:07:57.164939 18656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.227.61@KRBTEST.COM; defaulting to no policy
I20260811 11:07:57.176394 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.165856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39929 (local address 127.0.0.1:57986)
0811 11:07:57.166653 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.166694 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.167194 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.167505 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.167508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.167798 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.167955 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.167959 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.169474 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.169475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.170243 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.170251 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.170994 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.170995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.171052 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.171612 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.171620 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.173004 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.175001 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.175008 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.175009 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.175199 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.175539 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.175539 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.175540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.175630 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.175988 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.175993 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.176048 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.176121 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.176233 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":78,"threads_started":1}
I20260811 11:07:57.176555 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.165870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.25.227.62:39929)
0811 11:07:57.166078 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.166088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.166813 (+ 725us) server_negotiation.cc:407] Connection header received
0811 11:07:57.167370 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.167372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.167394 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.167504 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.168062 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.169380 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.170344 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.170901 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.171028 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.173096 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.173105 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.173106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.173114 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.174928 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.175329 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.175333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.175334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.175449 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.175700 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.175701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.175701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.175924 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.175995 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.176246 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.176324 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":103,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.61@KRBTEST.COM" created.
I20260811 11:07:57.177315 18656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:07:57.177672 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.177553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42842)
0811 11:07:57.177601 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.177647 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:07:57.177843 18560 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
I20260811 11:07:57.178257 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.178164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42844)
0811 11:07:57.178212 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.178237 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 11:07:57.178380 18656 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:35941: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab.
Entry for principal kudu/127.25.227.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab.
I20260811 11:07:57.191648 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:35941
--webserver_interface=127.25.227.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab
--principal=kudu/127.25.227.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:39929,127.25.227.61:35941,127.25.227.60:43679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:07:57.227656 18656 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } attempt: 1
I20260811 11:07:57.228287 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.228099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42852)
0811 11:07:57.228182 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.228239 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 11:07:57.228736 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.228612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42862)
0811 11:07:57.228664 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.228701 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 11:07:57.228889 18656 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:35941: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
W20260811 11:07:57.275257 18666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:57.275460 18666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:57.275481 18666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:57.276675 18666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:07:57.276719 18666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:57.276733 18666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:57.276746 18666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:07:57.276758 18666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:07:57.278306 18666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:39929,127.25.227.61:35941,127.25.227.60:43679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab
--principal=kudu/127.25.227.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:35941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.227.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:57.278566 18666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:57.278802 18666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:57.284399 18672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:57.284375 18675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:57.284603 18666 server_base.cc:1034] running on GCE node
W20260811 11:07:57.284466 18678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:57.284989 18666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:57.285351 18666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:57.286520 18666 hybrid_clock.cc:648] HybridClock initialized: now 1786446477286515 us; error 34 us; skew 500 ppm
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:57.289109 18666 init.cc:377] Logged in from keytab as kudu/127.25.227.61@KRBTEST.COM (short username kudu)
I20260811 11:07:57.289568 18666 webserver.cc:460] Webserver started at http://127.25.227.61:36267/ using document root <none> and password file <none>
I20260811 11:07:57.289811 18666 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:57.289885 18666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:57.290036 18666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:07:57.291074 18666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data/instance:
uuid: "cfbc498ff19e4e428b2ec943878f6355"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "fc686410ce4600d39a07df8083148768"
server_key_iv: "d7c100bc448c30ab25c2a7566498eddf"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.291443 18666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal/instance:
uuid: "cfbc498ff19e4e428b2ec943878f6355"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "fc686410ce4600d39a07df8083148768"
server_key_iv: "d7c100bc448c30ab25c2a7566498eddf"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.292748 18666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:07:57.293540 18692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:57.293716 18666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:57.293838 18666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal
uuid: "cfbc498ff19e4e428b2ec943878f6355"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "fc686410ce4600d39a07df8083148768"
server_key_iv: "d7c100bc448c30ab25c2a7566498eddf"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.293918 18666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:57.297078 18656 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } attempt: 2
I20260811 11:07:57.297540 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.297394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42868)
0811 11:07:57.297466 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.297509 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 11:07:57.297899 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.297814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42876)
0811 11:07:57.297854 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.297880 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 11:07:57.298002 18656 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:35941: Network error: Client connection negotiation failed: client connection to 127.25.227.61:35941: connect: Connection refused (error 111)
I20260811 11:07:57.313390 18666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:57.315227 18666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:57.315389 18666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:57.319556 18666 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.61:35941
I20260811 11:07:57.319612 18783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.61:35941 every 8 connection(s)
I20260811 11:07:57.319975 18666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
I20260811 11:07:57.320894 18784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:57.322551 18784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:07:57.326977 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 18666
I20260811 11:07:57.327116 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-1/wal/instance
I20260811 11:07:57.327334 26508 external_mini_cluster.cc:1428] Setting key d6424e3ae46c2af9b02df5aaa93ead42
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:57.331771 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.323249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39929 (local address 127.0.0.1:57996)
0811 11:07:57.323414 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.323456 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.323894 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.324166 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.324169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.324428 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.324615 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.324619 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.325357 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.325358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.326125 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.326127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.326494 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.326495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.326597 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.327132 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.327149 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.328646 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.330379 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.330387 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.330390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.330671 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.330904 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.330905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.330905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.331007 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.331300 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.331305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.331417 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.331498 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.331613 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260811 11:07:57.331792 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.323264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57996 (local address 127.25.227.62:39929)
0811 11:07:57.323348 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.323350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.323548 (+ 198us) server_negotiation.cc:407] Connection header received
0811 11:07:57.324009 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.324010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.324025 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.324088 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.324706 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.325277 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.326209 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.326415 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.326474 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.328737 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.328739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.328739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.328747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.330294 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.330767 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.330769 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.330769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.330838 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.331072 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.331073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.331074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.331223 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.331295 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.331545 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.331649 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:07:57.332492 18784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.25.227.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.60@KRBTEST.COM" created.
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:07:57.342836 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.332863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42882 (local address 127.25.227.61:35941)
0811 11:07:57.333032 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.333036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.333052 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:07:57.333069 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.333070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.333080 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.333162 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.333452 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.334117 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.334807 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.335103 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.335184 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.339703 (+ 4519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.339712 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.339712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.339720 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.341499 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.341916 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.341918 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.341918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.341972 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.342183 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.342184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.342184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.342336 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.342398 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.342574 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.342711 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
I20260811 11:07:57.342890 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.332783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42882)
0811 11:07:57.332844 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.332860 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.332889 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.333162 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.333163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.333325 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.333366 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.333368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.334220 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.334221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.334703 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.334705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.335180 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.335181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.335254 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.335667 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.335672 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.339607 (+ 3935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.341581 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.341582 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.341583 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.341825 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.342041 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.342042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.342043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.342118 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.342407 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.342408 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.342460 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.342537 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.342663 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 11:07:57.343834 18784 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:07:57.344218 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.344067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40516)
0811 11:07:57.344122 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.344182 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 11:07:57.344376 18696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
I20260811 11:07:57.344831 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.344709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40524)
0811 11:07:57.344766 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.344800 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 11:07:57.344961 18784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:43679: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab.
Entry for principal kudu/127.25.227.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab.
I20260811 11:07:57.354348 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:43679
--webserver_interface=127.25.227.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab
--principal=kudu/127.25.227.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:43473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:39929,127.25.227.61:35941,127.25.227.60:43679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:07:57.389206 18656 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } attempt: 3
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:07:57.394223 18784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } attempt: 1
I20260811 11:07:57.394662 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.394507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40534)
0811 11:07:57.394579 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.394622 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 11:07:57.395187 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.395075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40544)
0811 11:07:57.395125 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.395158 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 11:07:57.395345 18784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:43679: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
I20260811 11:07:57.397006 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.389685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42890 (local address 127.25.227.61:35941)
0811 11:07:57.389757 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.389759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.389771 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:07:57.389839 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.389841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.389854 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.389930 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.390282 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.390791 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.391478 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.391700 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.391782 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.393965 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.393966 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.393967 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.393977 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.395717 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.396142 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.396143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.396144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.396209 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.396448 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.396449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.396449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.396610 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.396676 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.396835 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.396917 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:07:57.397010 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.389613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42890)
0811 11:07:57.389676 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.389697 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.389776 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.389938 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.389939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.390110 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.390177 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.390179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.390888 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.390890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.391391 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.391393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.391785 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.391786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.391878 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.392393 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.392398 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.393869 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.395810 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.395811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.395811 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.396065 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.396290 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.396291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.396292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.396357 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.396667 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.396668 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.396718 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.396807 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.396915 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 11:07:57.397403 18656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:07:57.397725 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.397619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40550)
0811 11:07:57.397670 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.397699 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 11:07:57.398026 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.397933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40558)
0811 11:07:57.397983 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.398006 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 11:07:57.398120 18656 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:43679: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
I20260811 11:07:57.429345 18656 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } attempt: 1
I20260811 11:07:57.429840 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.429689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40560)
0811 11:07:57.429781 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.429812 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 11:07:57.430186 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.430086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40566)
0811 11:07:57.430133 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.430160 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:07:57.430287 18656 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:43679: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
W20260811 11:07:57.439817 18797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:07:57.440042 18797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:07:57.440081 18797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:07:57.441248 18797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:07:57.441311 18797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:07:57.441342 18797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:07:57.441375 18797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:07:57.441398 18797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:07:57.442876 18797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:39929,127.25.227.61:35941,127.25.227.60:43679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab
--principal=kudu/127.25.227.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:43679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.227.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:07:57.443161 18797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:07:57.443393 18797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:07:57.448328 18819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:57.448382 18797 server_base.cc:1034] running on GCE node
W20260811 11:07:57.448338 18813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:07:57.448354 18812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:07:57.448881 18797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:07:57.449262 18797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:07:57.450434 18797 hybrid_clock.cc:648] HybridClock initialized: now 1786446477450411 us; error 36 us; skew 500 ppm
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:07:57.453035 18797 init.cc:377] Logged in from keytab as kudu/127.25.227.60@KRBTEST.COM (short username kudu)
I20260811 11:07:57.453579 18797 webserver.cc:460] Webserver started at http://127.25.227.60:39051/ using document root <none> and password file <none>
I20260811 11:07:57.453817 18797 fs_manager.cc:359] Metadata directory not provided
I20260811 11:07:57.453895 18797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:07:57.454033 18797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:07:57.455127 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data/instance:
uuid: "e54ba9e56a994cd78108561db9b35980"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "f7da6f6f978cfb3457a53965126617fb"
server_key_iv: "a61d01d59b4977e021e46a8c8da52881"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.455507 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal/instance:
uuid: "e54ba9e56a994cd78108561db9b35980"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "f7da6f6f978cfb3457a53965126617fb"
server_key_iv: "a61d01d59b4977e021e46a8c8da52881"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.456903 18797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:07:57.457753 18829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:07:57.457945 18797 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:07:57.458051 18797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal
uuid: "e54ba9e56a994cd78108561db9b35980"
format_stamp: "Formatted at 2026-08-11 11:07:57 on dist-test-slave-z8x9"
server_key: "f7da6f6f978cfb3457a53965126617fb"
server_key_iv: "a61d01d59b4977e021e46a8c8da52881"
server_key_version: "encryptionkey@0"
I20260811 11:07:57.458137 18797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:07:57.463522 18784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } attempt: 2
I20260811 11:07:57.463948 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.463818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40580)
0811 11:07:57.463879 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.463918 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 11:07:57.464298 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.464188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40584)
0811 11:07:57.464235 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.464267 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:07:57.464388 18784 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:43679: Network error: Client connection negotiation failed: client connection to 127.25.227.60:43679: connect: Connection refused (error 111)
I20260811 11:07:57.470351 18797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:07:57.472721 18797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:07:57.472901 18797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:07:57.477020 18797 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.60:43679
I20260811 11:07:57.477051 18930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.60:43679 every 8 connection(s)
I20260811 11:07:57.477430 18797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
I20260811 11:07:57.478304 18931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:07:57.479489 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 18797
I20260811 11:07:57.479622 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786446315517896-26508-0/minicluster-data/master-2/wal/instance
I20260811 11:07:57.479807 26508 external_mini_cluster.cc:1428] Setting key ddf04545bda6d11e7d8f134f384c3dd1
I20260811 11:07:57.479954 18931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:07:57.489902 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.480704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58008 (local address 127.25.227.62:39929)
0811 11:07:57.480752 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.480754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.480877 (+ 123us) server_negotiation.cc:407] Connection header received
0811 11:07:57.481258 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.481260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.481272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.481326 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.482097 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.482851 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.484021 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.484283 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.484351 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.486690 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.486692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.486692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.486701 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.488340 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.488865 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.488867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.488867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.488937 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.489210 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.489211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.489211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.489343 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.489417 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.489701 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.489805 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 11:07:57.490141 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.480625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:39929 (local address 127.0.0.1:58008)
0811 11:07:57.480751 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.480790 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.481139 (+ 349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.481365 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.481368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.481763 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.482011 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.482018 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.482930 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.482931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.483936 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.483939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.484373 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.484374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.484480 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.484960 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.484971 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.486596 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.488428 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.488435 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.488438 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.488699 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.489014 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.489015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.489015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.489127 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.489423 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.489430 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.489562 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.489661 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.489873 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":65,"threads_started":1}
I20260811 11:07:57.490161 18937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.480355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40596 (local address 127.25.227.60:43679)
0811 11:07:57.480552 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.480561 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.480603 (+ 42us) server_negotiation.cc:407] Connection header received
0811 11:07:57.481124 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.481131 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.481162 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.481302 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.482081 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.483161 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.484148 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.484557 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.484607 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.487171 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.487179 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.487180 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.487188 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.488834 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.489227 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.489230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.489230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.489290 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.489515 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.489516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.489516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.489652 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.489814 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.489860 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.489941 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260811 11:07:57.490653 18931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:07:57.498436 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.491051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.25.227.61:35941)
0811 11:07:57.491119 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.491121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.491130 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:07:57.491156 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.491157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.491166 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.491223 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.491506 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.492202 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.492978 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.493292 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.493378 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.495593 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.495594 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.495595 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.495603 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.497325 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.497700 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.497701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.497702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.497765 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.497985 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.497986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.497986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.498090 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.498142 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.498313 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.498374 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:07:57.498504 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.490961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:35941 (local address 127.0.0.1:42896)
0811 11:07:57.491010 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.491022 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.491061 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.491219 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.491219 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.491378 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.491433 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.491435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.492273 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.492274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.492903 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.492905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.493386 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.493387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.493454 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.493850 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.493855 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.495490 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.497403 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.497404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.497404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.497620 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.497841 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.497842 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.497843 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.497911 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.498158 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.498159 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.498204 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.498286 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.498378 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 11:07:57.498898 18931 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:07:57.499974 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.491292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58024 (local address 127.25.227.62:39929)
0811 11:07:57.491354 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.491356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.491364 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:07:57.491384 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.491385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.491393 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.491454 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.492014 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.492582 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.493410 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.493682 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.493769 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.496851 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.496852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.496852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.496860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.498616 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.499005 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.499006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.499006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.499234 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.499466 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.499467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.499467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.499566 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.499756 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.499796 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.499882 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:07:57.505442 18656 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } attempt: 2
I20260811 11:07:57.506531 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.499134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40606)
0811 11:07:57.499184 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.499195 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.499228 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.499365 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.499365 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.499513 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.499548 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.499549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.500359 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.500360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.501123 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.501126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.501581 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.501581 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.501620 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.501984 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.501988 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.503313 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.505078 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.505079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.505080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.505318 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.505541 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.505541 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.505542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.505614 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.506206 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.506207 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.506249 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.506319 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.506428 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 11:07:57.506819 18937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.499193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40606 (local address 127.25.227.60:43679)
0811 11:07:57.499230 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.499231 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.499240 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:07:57.499284 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.499285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.499295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.499356 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.499617 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.500268 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.501254 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.501502 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.501572 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.503411 (+ 1839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.503413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.503413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.503420 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.504980 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.505402 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.505403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.505403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.505465 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.505688 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.505689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.505690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.506129 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.506213 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.506366 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.506719 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:07:57.508751 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.500657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.25.227.61:35941)
0811 11:07:57.500691 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.500693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.500700 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:07:57.500758 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.500758 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.500765 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.500804 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.501392 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.502039 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.502802 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.503097 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.503152 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.505574 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.505575 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.505575 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.505582 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.507532 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.507900 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.507902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.507902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.507962 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.508194 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.508195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.508195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.508325 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.508553 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.508590 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.508663 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:07:57.509536 18931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: Bootstrap starting.
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:07:57.510349 18931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:57.510692 18931 log.cc:824] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:57.511441 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:07:57.511587 18931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: No bootstrap required, opened a new log
I20260811 11:07:57.513406 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.505678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40610)
0811 11:07:57.505715 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.505725 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.505759 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.506133 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.506134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.506300 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.506341 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.506343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.507166 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.507167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.507745 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.507747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.508263 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.508265 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.508325 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.508820 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.508825 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.510413 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.512206 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.512207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.512207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.512390 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.512645 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.512646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.512647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.512707 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.513049 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.513050 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.513098 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.513201 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.513306 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 11:07:57.513815 18931 raft_consensus.cc:348] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.514052 18931 raft_consensus.cc:374] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:57.514089 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.505819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40610 (local address 127.25.227.60:43679)
0811 11:07:57.506008 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.506010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.506017 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:07:57.506035 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.506035 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.506051 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.506127 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.506436 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.507102 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.507842 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.508129 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.508241 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.510500 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.510500 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.510501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.510506 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.512102 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.512473 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.512474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.512474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.512559 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.512782 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.512783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.512783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.512960 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.513035 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.513894 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.513980 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":140,"threads_started":1}
I20260811 11:07:57.514168 18931 raft_consensus.cc:729] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54ba9e56a994cd78108561db9b35980, State: Initialized, Role: FOLLOWER
I20260811 11:07:57.514536 18931 consensus_queue.cc:260] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.514863 18931 sys_catalog.cc:564] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:07:57.516328 18957 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.516531 18957 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:07:57.516716 18656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba: Bootstrap starting.
W20260811 11:07:57.517081 18975 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:07:57.517140 18975 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:07:57.517534 18656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:57.517870 18656 log.cc:824] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:57.518950 18656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba: No bootstrap required, opened a new log
I20260811 11:07:57.520912 18656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.521049 18656 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:57.521081 18656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1823bf8e475349b7af071376b1f052ba, State: Initialized, Role: FOLLOWER
I20260811 11:07:57.518910 18797 master_runner.cc:186] Error getting master registration for 127.25.227.62:39929: OK, instance_id { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" instance_seqno: 1786446477160282 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:07:57.521224 18797 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:07:57.521365 18656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.521728 18656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:07:57.521678 18978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.522109 18978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:07:57.524077 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.513511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42916 (local address 127.25.227.61:35941)
0811 11:07:57.513726 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.513728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.513765 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:07:57.513866 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.513867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.513878 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.513908 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.514597 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.515233 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.516208 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.516511 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.516559 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.518152 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.518153 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.518153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.518161 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.522641 (+ 4480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.523080 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.523082 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.523082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.523145 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.523468 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.523469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.523469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.523602 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.523685 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.523905 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.523987 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
W20260811 11:07:57.524814 18997 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:07:57.524938 18997 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:07:57.524586 18526 master_runner.cc:186] Error getting master registration for 127.25.227.61:35941: OK, instance_id { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" instance_seqno: 1786446477318329 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:07:57.528829 18526 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:07:57.529937 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.512934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.25.227.62:39929)
0811 11:07:57.512972 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.512974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.513258 (+ 284us) server_negotiation.cc:407] Connection header received
0811 11:07:57.513371 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.513373 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.513384 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.513414 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.514225 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.514939 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.523667 (+ 8728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.523951 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.523991 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.526177 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.526179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.526179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.526187 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.527848 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.528227 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.528228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.528229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.528300 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.529036 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.529037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.529038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.529204 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.529290 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.529759 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.529844 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:07:57.532137 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.513532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40626 (local address 127.25.227.60:43679)
0811 11:07:57.514309 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.514311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.525059 (+ 10748us) server_negotiation.cc:407] Connection header received
0811 11:07:57.525154 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.525155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.525188 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.525221 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.525818 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.526583 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.527558 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.527863 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.527905 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.529240 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.529241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.529241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.529258 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.530864 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.531251 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.531252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.531253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.531320 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.531562 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.531563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.531563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.531705 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.531814 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.531964 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.532051 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764}
I20260811 11:07:57.555544 18784 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } attempt: 3
Aug 11 11:07:57 dist-test-slave-z8x9 krb5kdc[18501](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446477, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:07:57.564603 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.555857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:43679 (local address 127.0.0.1:40630)
0811 11:07:57.555911 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 11:07:57.555924 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:07:57.555961 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:07:57.556113 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:07:57.556114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:07:57.556328 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:07:57.556385 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.556387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.557345 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.557346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.558161 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:07:57.558164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.558656 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.558658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:07:57.558721 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.559264 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:07:57.559270 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:07:57.560866 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:07:57.563434 (+ 2568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.563435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.563435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.563665 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.563885 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:07:57.563886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:07:57.563886 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:07:57.563958 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:07:57.564239 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:07:57.564241 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:07:57.564303 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 11:07:57.564380 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:07:57.564479 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 11:07:57.564632 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:07:57.555921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40630 (local address 127.25.227.60:43679)
0811 11:07:57.555964 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:07:57.555967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:07:57.556002 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:07:57.556024 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:07:57.556025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:07:57.556035 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:07:57.556089 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:07:57.556468 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.557260 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.558254 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:07:57.558574 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:07:57.558645 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:07:57.560959 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:07:57.560961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:07:57.560961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:07:57.560969 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:07:57.563348 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.563744 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.563746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.563746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.563811 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:07:57.564028 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:07:57.564028 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:07:57.564029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:07:57.564167 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:07:57.564238 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:07:57.564434 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 11:07:57.564519 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:07:57.566745 18784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: Bootstrap starting.
I20260811 11:07:57.567535 18784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: Neither blocks nor log segments found. Creating new log.
I20260811 11:07:57.567831 18784 log.cc:824] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: Log is configured to *not* fsync() on all Append() calls
I20260811 11:07:57.568758 18784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: No bootstrap required, opened a new log
I20260811 11:07:57.570781 18784 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.570927 18784 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:07:57.570963 18784 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbc498ff19e4e428b2ec943878f6355, State: Initialized, Role: FOLLOWER
I20260811 11:07:57.571498 18784 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.571928 18784 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:07:57.571897 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.572135 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 11:07:57.573895 19024 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:07:57.574007 19024 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:07:57.575868 18666 master_runner.cc:263] No leader master found from master cfbc498ff19e4e428b2ec943878f6355
I20260811 11:07:57.575915 18666 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:07:57.587483 18978 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:07:57.587589 18978 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.587779 18978 leader_election.cc:288] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfbc498ff19e4e428b2ec943878f6355 (127.25.227.61:35941), e54ba9e56a994cd78108561db9b35980 (127.25.227.60:43679)
I20260811 11:07:57.588171 18884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1823bf8e475349b7af071376b1f052ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54ba9e56a994cd78108561db9b35980" is_pre_election: true
I20260811 11:07:57.588317 18884 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1823bf8e475349b7af071376b1f052ba in term 0.
I20260811 11:07:57.588517 18560 leader_election.cc:302] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1823bf8e475349b7af071376b1f052ba, e54ba9e56a994cd78108561db9b35980; no voters:
I20260811 11:07:57.589144 18746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1823bf8e475349b7af071376b1f052ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbc498ff19e4e428b2ec943878f6355" is_pre_election: true
I20260811 11:07:57.589308 18746 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1823bf8e475349b7af071376b1f052ba in term 0.
I20260811 11:07:57.589476 18978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:07:57.589535 18978 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:07:57.589557 18978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:57.590405 18978 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.590520 18978 leader_election.cc:288] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [CANDIDATE]: Term 1 election: Requested vote from peers cfbc498ff19e4e428b2ec943878f6355 (127.25.227.61:35941), e54ba9e56a994cd78108561db9b35980 (127.25.227.60:43679)
I20260811 11:07:57.590883 18884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1823bf8e475349b7af071376b1f052ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e54ba9e56a994cd78108561db9b35980"
I20260811 11:07:57.590956 18884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:57.591728 18884 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1823bf8e475349b7af071376b1f052ba in term 1.
I20260811 11:07:57.591915 18560 leader_election.cc:302] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1823bf8e475349b7af071376b1f052ba, e54ba9e56a994cd78108561db9b35980; no voters:
I20260811 11:07:57.592164 18746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1823bf8e475349b7af071376b1f052ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfbc498ff19e4e428b2ec943878f6355"
I20260811 11:07:57.592238 18746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:07:57.593084 18746 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1823bf8e475349b7af071376b1f052ba in term 1.
I20260811 11:07:57.593449 18978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:07:57.593616 18978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [term 1 LEADER]: Becoming Leader. State: Replica: 1823bf8e475349b7af071376b1f052ba, State: Running, Role: LEADER
I20260811 11:07:57.593700 18978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } }
I20260811 11:07:57.594058 18978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1823bf8e475349b7af071376b1f052ba. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.594123 18978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:57.595258 19028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:07:57.595479 19028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:07:57.597271 18884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [term 1 FOLLOWER]: Refusing update from remote peer 1823bf8e475349b7af071376b1f052ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:07:57.597709 18978 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:07:57.598629 18746 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [term 1 FOLLOWER]: Refusing update from remote peer 1823bf8e475349b7af071376b1f052ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:07:57.598953 18978 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:07:57.599396 18957 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1823bf8e475349b7af071376b1f052ba. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.599489 18957 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:07:57.600148 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1823bf8e475349b7af071376b1f052ba. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.600227 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:07:57.602438 18978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.602519 18978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:57.602864 18957 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.602957 18957 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:07:57.603679 18978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.603753 18978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba [sys.catalog]: This master's current role is: LEADER
I20260811 11:07:57.604177 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1823bf8e475349b7af071376b1f052ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1823bf8e475349b7af071376b1f052ba" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 39929 } } peers { permanent_uuid: "cfbc498ff19e4e428b2ec943878f6355" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 35941 } } peers { permanent_uuid: "e54ba9e56a994cd78108561db9b35980" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 43679 } } }
I20260811 11:07:57.604275 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:07:57.605543 19033 mvcc.cc:205] Tried to move back new op lower bound from 7317284772235952128 to 7317284772224212992. Current Snapshot: MvccSnapshot[applied={T|T < 7317284772235952128}]
I20260811 11:07:57.605587 19031 mvcc.cc:205] Tried to move back new op lower bound from 7317284772235952128 to 7317284772224212992. Current Snapshot: MvccSnapshot[applied={T|T < 7317284772235952128}]
I20260811 11:07:57.606643 19028 catalog_manager.cc:1347] Generated new cluster ID: 823a6dbcfd674f2a80e4663f45b075d2
I20260811 11:07:57.606693 19028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:07:57.625685 19028 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:07:57.626489 19028 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:07:57.638478 19028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1823bf8e475349b7af071376b1f052ba: Generated new TSK 0
I20260811 11:07:57.638753 19028 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:07:58.517635 18975 catalog_manager.cc:1259] Loaded cluster ID: 823a6dbcfd674f2a80e4663f45b075d2
I20260811 11:07:58.517721 18975 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: loading cluster ID for follower catalog manager: success
I20260811 11:07:58.518564 18975 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: acquiring CA information for follower catalog manager: success
I20260811 11:07:58.518886 18975 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e54ba9e56a994cd78108561db9b35980: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:07:58.574515 19024 catalog_manager.cc:1259] Loaded cluster ID: 823a6dbcfd674f2a80e4663f45b075d2
I20260811 11:07:58.574605 19024 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: loading cluster ID for follower catalog manager: success
I20260811 11:07:58.575471 19024 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: acquiring CA information for follower catalog manager: success
I20260811 11:07:58.575901 19024 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cfbc498ff19e4e428b2ec943878f6355: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:07:58.695209 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 18526
I20260811 11:07:58.707279 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 18666
I20260811 11:07:58.720705 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 18797
2026-08-11T11:07:58Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3140 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:07:58 dist-test-slave-z8x9 krb5kdc[19061](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:07:58 dist-test-slave-z8x9 krb5kdc[19061](info): set up 2 sockets
Aug 11 11:07:58 dist-test-slave-z8x9 krb5kdc[19061](info): commencing operation
krb5kdc: starting...
W20260811 11:08:00.030550 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:08:00 dist-test-slave-z8x9 krb5kdc[19061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:08:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:08:00.158342 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36669
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:32789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:36669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:00.241746 19080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:00.241999 19080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:00.242036 19080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:00.243155 19080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:08:00.243225 19080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:00.243250 19080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:00.243268 19080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:08:00.243285 19080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:08:00.244717 19080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:32789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:36669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:36669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:00.245008 19080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:00.245249 19080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:00.250116 19091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:00.250135 19089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:00.250141 19094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:00.250952 19080 server_base.cc:1034] running on GCE node
I20260811 11:08:00.251298 19080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:00.251683 19080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:00.252840 19080 hybrid_clock.cc:648] HybridClock initialized: now 1786446480252818 us; error 40 us; skew 500 ppm
Aug 11 11:08:00 dist-test-slave-z8x9 krb5kdc[19061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446480, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:00.255556 19080 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:08:00.256036 19080 webserver.cc:460] Webserver started at http://127.25.227.62:37031/ using document root <none> and password file <none>
I20260811 11:08:00.256271 19080 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:00.256345 19080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:00.256484 19080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:00.257620 19080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "b8a04008881542868243bae47d385c6e"
format_stamp: "Formatted at 2026-08-11 11:08:00 on dist-test-slave-z8x9"
server_key: "26969b077b7ee8725b8b0b8abc8b9bef"
server_key_iv: "f1a155a91c64d67ff6c4154adf456e28"
server_key_version: "encryptionkey@0"
I20260811 11:08:00.257989 19080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "b8a04008881542868243bae47d385c6e"
format_stamp: "Formatted at 2026-08-11 11:08:00 on dist-test-slave-z8x9"
server_key: "26969b077b7ee8725b8b0b8abc8b9bef"
server_key_iv: "f1a155a91c64d67ff6c4154adf456e28"
server_key_version: "encryptionkey@0"
I20260811 11:08:00.259374 19080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:00.260098 19101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:00.260294 19080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:08:00.260396 19080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "b8a04008881542868243bae47d385c6e"
format_stamp: "Formatted at 2026-08-11 11:08:00 on dist-test-slave-z8x9"
server_key: "26969b077b7ee8725b8b0b8abc8b9bef"
server_key_iv: "f1a155a91c64d67ff6c4154adf456e28"
server_key_version: "encryptionkey@0"
I20260811 11:08:00.260478 19080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:00.267287 19080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:00.269554 19080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:00.269718 19080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:00.273907 19080 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:36669
I20260811 11:08:00.273952 19196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:36669 every 8 connection(s)
I20260811 11:08:00.274299 19080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:08:00.275148 19197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:00.277597 19197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e: Bootstrap starting.
I20260811 11:08:00.278195 19197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:00.278520 19197 log.cc:824] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:00.279239 19197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e: No bootstrap required, opened a new log
I20260811 11:08:00.280884 19197 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a04008881542868243bae47d385c6e" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36669 } }
I20260811 11:08:00.281021 19197 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:00.281044 19197 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a04008881542868243bae47d385c6e, State: Initialized, Role: FOLLOWER
I20260811 11:08:00.281251 19197 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a04008881542868243bae47d385c6e" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36669 } }
I20260811 11:08:00.281322 19197 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:08:00.281343 19197 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:08:00.281419 19197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:00.281963 19197 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a04008881542868243bae47d385c6e" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36669 } }
I20260811 11:08:00.282081 19197 leader_election.cc:302] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a04008881542868243bae47d385c6e; no voters:
I20260811 11:08:00.282272 19197 leader_election.cc:288] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:08:00.282332 19206 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:00.282534 19206 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [term 1 LEADER]: Becoming Leader. State: Replica: b8a04008881542868243bae47d385c6e, State: Running, Role: LEADER
I20260811 11:08:00.282564 19197 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:08:00.282625 19206 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a04008881542868243bae47d385c6e" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36669 } }
I20260811 11:08:00.283077 19211 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a04008881542868243bae47d385c6e. Latest consensus state: current_term: 1 leader_uuid: "b8a04008881542868243bae47d385c6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a04008881542868243bae47d385c6e" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36669 } } }
I20260811 11:08:00.283169 19211 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:00.283221 19209 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8a04008881542868243bae47d385c6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a04008881542868243bae47d385c6e" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 36669 } } }
I20260811 11:08:00.283320 19209 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:00.283425 19223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:08:00.283845 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 19080
I20260811 11:08:00.283962 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:08:00.284053 19223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:08:00.284189 26508 external_mini_cluster.cc:1428] Setting key 0cbcb12d5154c25871a121a096a1b1c5
I20260811 11:08:00.285722 19223 catalog_manager.cc:1347] Generated new cluster ID: 83d7c74373d341e89fecf8f84f9c0f6e
I20260811 11:08:00.285781 19223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:08:00 dist-test-slave-z8x9 krb5kdc[19061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:00.294373 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:00.284692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54644 (local address 127.25.227.62:36669)
0811 11:08:00.284863 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:00.284872 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:00.285011 (+ 139us) server_negotiation.cc:407] Connection header received
0811 11:08:00.285213 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:00.285221 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:00.285311 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:00.285450 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:00.286217 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:00.287137 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:00.287909 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:00.288345 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:00.288461 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:00.290956 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:00.290961 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:00.290961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:00.290973 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:00.292705 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:00.293103 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:00.293106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:00.293106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:00.293279 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:00.293497 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:00.293498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:00.293498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:00.293741 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:00.293941 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:00.294009 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 11:08:00.294156 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260811 11:08:00.295303 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:08:00.303731 19223 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:08:00.304481 19223 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:08:00.308697 19223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8a04008881542868243bae47d385c6e: Generated new TSK 0
I20260811 11:08:00.308876 19223 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:08:00.349308 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 19080
2026-08-11T11:08:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1623 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:08:00 dist-test-slave-z8x9 krb5kdc[19246](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:08:00 dist-test-slave-z8x9 krb5kdc[19246](info): set up 2 sockets
Aug 11 11:08:00 dist-test-slave-z8x9 krb5kdc[19246](info): commencing operation
krb5kdc: starting...
W20260811 11:08:01.648017 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:08:01 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:08:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:08:01.779785 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35301
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:01.864408 19264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:01.864662 19264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:01.864701 19264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:01.865918 19264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:08:01.866006 19264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:01.866036 19264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:01.866071 19264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:08:01.866096 19264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:08:01.867573 19264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:01.867875 19264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:01.868109 19264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:01.872964 19272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:01.872957 19276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:01.872958 19273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:01.873417 19264 server_base.cc:1034] running on GCE node
I20260811 11:08:01.873777 19264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:01.874019 19264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:01.875196 19264 hybrid_clock.cc:648] HybridClock initialized: now 1786446481875173 us; error 41 us; skew 500 ppm
Aug 11 11:08:01 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446481, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:01.877894 19264 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:08:01.878367 19264 webserver.cc:460] Webserver started at http://127.25.227.62:43997/ using document root <none> and password file <none>
I20260811 11:08:01.878593 19264 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:01.878661 19264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:01.878829 19264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:01.879858 19264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "480dfcd0c7d24e2cb93e427f466c9cc5"
format_stamp: "Formatted at 2026-08-11 11:08:01 on dist-test-slave-z8x9"
server_key: "37f30319a5af2bd091f3bda0035a279e"
server_key_iv: "6743587be6fcc2d1ec3d2cf462298853"
server_key_version: "encryptionkey@0"
I20260811 11:08:01.880225 19264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "480dfcd0c7d24e2cb93e427f466c9cc5"
format_stamp: "Formatted at 2026-08-11 11:08:01 on dist-test-slave-z8x9"
server_key: "37f30319a5af2bd091f3bda0035a279e"
server_key_iv: "6743587be6fcc2d1ec3d2cf462298853"
server_key_version: "encryptionkey@0"
I20260811 11:08:01.881664 19264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:08:01.882455 19293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:01.882638 19264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:08:01.882767 19264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "480dfcd0c7d24e2cb93e427f466c9cc5"
format_stamp: "Formatted at 2026-08-11 11:08:01 on dist-test-slave-z8x9"
server_key: "37f30319a5af2bd091f3bda0035a279e"
server_key_iv: "6743587be6fcc2d1ec3d2cf462298853"
server_key_version: "encryptionkey@0"
I20260811 11:08:01.882846 19264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:01.901925 19264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:01.904423 19264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:01.904594 19264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:01.909188 19264 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35301
I20260811 11:08:01.909267 19390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35301 every 8 connection(s)
I20260811 11:08:01.909660 19264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:08:01.910682 19394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:01.913013 19394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap starting.
I20260811 11:08:01.913653 19394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:01.913905 19394 log.cc:824] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:01.914604 19394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: No bootstrap required, opened a new log
I20260811 11:08:01.914867 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 19264
I20260811 11:08:01.914994 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:08:01.915217 26508 external_mini_cluster.cc:1428] Setting key 1dd929338f8501fabbd9978a29700db4
I20260811 11:08:01.916824 19394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:01.916992 19394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:01.917032 19394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480dfcd0c7d24e2cb93e427f466c9cc5, State: Initialized, Role: FOLLOWER
I20260811 11:08:01.917225 19394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:01.917336 19394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:08:01.917371 19394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:08:01.917425 19394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:01.918412 19394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:01.918503 19394 leader_election.cc:302] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 480dfcd0c7d24e2cb93e427f466c9cc5; no voters:
I20260811 11:08:01.918684 19394 leader_election.cc:288] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:08:01.918730 19400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:01.918883 19400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 LEADER]: Becoming Leader. State: Replica: 480dfcd0c7d24e2cb93e427f466c9cc5, State: Running, Role: LEADER
I20260811 11:08:01.918965 19394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:08:01.918964 19400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:01.919379 19401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } } }
I20260811 11:08:01.919384 19402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 480dfcd0c7d24e2cb93e427f466c9cc5. Latest consensus state: current_term: 1 leader_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } } }
I20260811 11:08:01.919565 19401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:01.919592 19402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:01.919906 19416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:08:01.920471 19416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:08:01.922339 19416 catalog_manager.cc:1347] Generated new cluster ID: 1bba46f4f9404e9595d9427fe27fb6f6
I20260811 11:08:01.922398 19416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:08:01 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:01.928192 19399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:01.915817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57862 (local address 127.25.227.62:35301)
0811 11:08:01.916022 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:01.916030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:01.916057 (+ 27us) server_negotiation.cc:407] Connection header received
0811 11:08:01.916805 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:01.916812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:01.916858 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:01.916972 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:01.917872 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:01.918986 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:01.920142 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:01.920826 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:01.920934 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:01.923956 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:01.923960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:01.923960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:01.923973 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:01.926013 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:01.926433 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:01.926436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:01.926437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:01.926567 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:01.926802 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:01.926803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:01.926803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:01.927090 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:01.927799 (+ 709us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:01.927871 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 11:08:01.928002 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260811 11:08:01.935457 19416 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:08:01.935961 19416 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:08:01.943235 19416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Generated new TSK 0
I20260811 11:08:01.943434 19416 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:08:01.974232 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35301
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:02.060382 19435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:02.060611 19435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:02.060662 19435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:02.061807 19435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:02.061875 19435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:02.061919 19435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:08:02.063373 19435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:02.063629 19435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:02.063858 19435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:02.068962 19455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.068984 19448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.069209 19452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.069115 19435 server_base.cc:1034] running on GCE node
I20260811 11:08:02.069562 19435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:02.069799 19435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:02.070960 19435 hybrid_clock.cc:648] HybridClock initialized: now 1786446482070948 us; error 29 us; skew 500 ppm
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:02.073593 19435 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:08:02.074028 19435 webserver.cc:460] Webserver started at http://127.25.227.1:37697/ using document root <none> and password file <none>
I20260811 11:08:02.074254 19435 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:02.074326 19435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:02.074477 19435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:02.075554 19435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "b34b999217184cd7965d067edb887d7e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "c188a8d42e3e14a0206aacfe26fd87fd"
server_key_iv: "079a77a6c4d4f070a9b62454a23b1b32"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.075928 19435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "b34b999217184cd7965d067edb887d7e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "c188a8d42e3e14a0206aacfe26fd87fd"
server_key_iv: "079a77a6c4d4f070a9b62454a23b1b32"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.077301 19435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:08:02.078097 19466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.078366 19435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:02.078476 19435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "b34b999217184cd7965d067edb887d7e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "c188a8d42e3e14a0206aacfe26fd87fd"
server_key_iv: "079a77a6c4d4f070a9b62454a23b1b32"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.078550 19435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:02.094424 19435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:02.096333 19435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:02.096503 19435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:02.096763 19435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:02.097078 19435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:02.097152 19435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.097218 19435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:02.097249 19435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.103268 19435 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:32977
I20260811 11:08:02.103332 19673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:32977 every 8 connection(s)
I20260811 11:08:02.103639 19435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:02.110762 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 19435
I20260811 11:08:02.110896 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:08:02.111135 26508 external_mini_cluster.cc:1428] Setting key eba282fe04143e8a0a4086d40cd7add7
I20260811 11:08:02.113401 19399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.104422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:56971 (local address 127.25.227.62:35301)
0811 11:08:02.104489 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.104491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.104702 (+ 211us) server_negotiation.cc:407] Connection header received
0811 11:08:02.105222 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.105223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.105237 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.105311 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:02.106335 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.106846 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.107910 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.108118 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.108174 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.110236 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:02.110237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:02.110238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:02.110249 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:02.111955 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.112359 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.112360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.112360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.112426 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.112662 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.112663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.112664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.112819 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:02.112889 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.113124 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.113259 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 11:08:02.113430 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.104401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:56971)
0811 11:08:02.104569 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.104613 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.105104 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.105367 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.105370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.105956 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:02.106244 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.106250 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.106927 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.106928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.107834 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.107836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.108193 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.108194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.108295 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.108742 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:02.108760 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:02.110149 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:02.112031 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.112038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.112040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.112279 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.112495 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.112495 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.112496 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.112596 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.112883 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:02.112888 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:02.112998 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.113078 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.113249 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260811 11:08:02.113931 19685 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35301
I20260811 11:08:02.114017 19685 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:02.114192 19685 heartbeater.cc:511] Master 127.25.227.62:35301 requested a full tablet report, sending...
I20260811 11:08:02.114753 19330 ts_manager.cc:194] Registered new tserver with Master: b34b999217184cd7965d067edb887d7e (127.25.227.1:32977)
I20260811 11:08:02.115338 19330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:56971
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:08:02.138132 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35301
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:02.220247 19695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:02.220475 19695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:02.220515 19695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:02.221726 19695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:02.221793 19695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:02.221838 19695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:08:02.223327 19695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:02.223600 19695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:02.223842 19695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:02.229113 19701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.229101 19702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.229374 19695 server_base.cc:1034] running on GCE node
W20260811 11:08:02.229101 19705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.229665 19695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:02.229918 19695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:02.231074 19695 hybrid_clock.cc:648] HybridClock initialized: now 1786446482231053 us; error 38 us; skew 500 ppm
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:02.238106 19695 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:08:02.238651 19695 webserver.cc:460] Webserver started at http://127.25.227.2:42921/ using document root <none> and password file <none>
I20260811 11:08:02.238912 19695 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:02.238958 19695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:02.239115 19695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:02.240211 19695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "4a62090b9a244e0eab924592afa2d30e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "b7f8e05848b00950d39d451dfc044f99"
server_key_iv: "e9278dd06d77617e8da0c66a679fc970"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.240563 19695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "4a62090b9a244e0eab924592afa2d30e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "b7f8e05848b00950d39d451dfc044f99"
server_key_iv: "e9278dd06d77617e8da0c66a679fc970"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.242004 19695 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:08:02.242996 19722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.243202 19695 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:02.243299 19695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "4a62090b9a244e0eab924592afa2d30e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "b7f8e05848b00950d39d451dfc044f99"
server_key_iv: "e9278dd06d77617e8da0c66a679fc970"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.243372 19695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:02.279273 19695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:02.281862 19695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:02.282027 19695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:02.282286 19695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:02.282658 19695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:02.282711 19695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.282753 19695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:02.282781 19695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.288985 19695 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:44613
I20260811 11:08:02.289031 19926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:44613 every 8 connection(s)
I20260811 11:08:02.289400 19695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:08:02.293629 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 19695
I20260811 11:08:02.293736 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:08:02.293938 26508 external_mini_cluster.cc:1428] Setting key 9dd2ca72629a237af9b76f37d62e65b3
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:02.299527 19935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.290177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:33643)
0811 11:08:02.290335 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.290379 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.290860 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.291067 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.291070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.291651 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:02.291848 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.291852 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.292544 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.292545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.293413 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.293415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.293912 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.293913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.294045 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.294636 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:02.294648 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:02.296330 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:02.298145 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.298153 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.298156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.298411 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.298630 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.298630 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.298631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.298744 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.299028 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:02.299033 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:02.299149 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.299233 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.299353 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
I20260811 11:08:02.299533 19399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.290204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:33643 (local address 127.25.227.62:35301)
0811 11:08:02.290271 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.290273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.290464 (+ 191us) server_negotiation.cc:407] Connection header received
0811 11:08:02.290942 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.290943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.290954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.291016 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:02.291944 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.292456 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.293498 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.293822 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.293906 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.296434 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:02.296436 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:02.296437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:02.296445 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:02.298062 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.298491 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.298492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.298493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.298561 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.298808 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.298810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.298810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.298963 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:02.299035 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.299279 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.299383 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:08:02.300097 19929 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35301
I20260811 11:08:02.300212 19929 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:02.300428 19929 heartbeater.cc:511] Master 127.25.227.62:35301 requested a full tablet report, sending...
I20260811 11:08:02.300859 19330 ts_manager.cc:194] Registered new tserver with Master: 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613)
I20260811 11:08:02.301282 19330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:33643
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:08:02.323398 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35301
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:02.409492 19938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:02.409708 19938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:02.409732 19938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:02.410916 19938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:02.410964 19938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:02.410990 19938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:08:02.412534 19938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:02.412811 19938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:02.413058 19938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:02.418321 19954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.418321 19955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.418424 19957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.418591 19938 server_base.cc:1034] running on GCE node
I20260811 11:08:02.418818 19938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:02.419278 19938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:02.420470 19938 hybrid_clock.cc:648] HybridClock initialized: now 1786446482420442 us; error 42 us; skew 500 ppm
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:02.423187 19938 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:08:02.423676 19938 webserver.cc:460] Webserver started at http://127.25.227.3:45335/ using document root <none> and password file <none>
I20260811 11:08:02.423935 19938 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:02.424008 19938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:02.424163 19938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:02.425321 19938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "3440cc29267e405faf25cd070dd333a8"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "e089fb19da707669a7c895b0837fbb3d"
server_key_iv: "711cdec7847411cf3c2e00bd323341c9"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.425699 19938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "3440cc29267e405faf25cd070dd333a8"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "e089fb19da707669a7c895b0837fbb3d"
server_key_iv: "711cdec7847411cf3c2e00bd323341c9"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.427135 19938 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:08:02.428014 19969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.428227 19938 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:02.428354 19938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "3440cc29267e405faf25cd070dd333a8"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "e089fb19da707669a7c895b0837fbb3d"
server_key_iv: "711cdec7847411cf3c2e00bd323341c9"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.428432 19938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:02.437590 19938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:02.439584 19938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:02.439743 19938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:02.439970 19938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:02.440299 19938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:02.440354 19938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.440397 19938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:02.440424 19938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.446790 19938 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:32953
I20260811 11:08:02.446830 20187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:32953 every 8 connection(s)
I20260811 11:08:02.447192 19938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:08:02.449316 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 19938
I20260811 11:08:02.449394 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:08:02.449570 26508 external_mini_cluster.cc:1428] Setting key caa3d133f05a5c438de2bf9aa9559117
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:02.457154 19399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.448009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35047 (local address 127.25.227.62:35301)
0811 11:08:02.448079 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.448082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.448302 (+ 220us) server_negotiation.cc:407] Connection header received
0811 11:08:02.448849 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.448851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.448866 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.448923 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:02.450246 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.450877 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.451811 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.451991 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.452050 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.454187 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:02.454188 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:02.454189 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:02.454196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:02.455854 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.456291 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.456292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.456293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.456352 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.456585 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.456585 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.456586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.456696 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:02.456752 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.457007 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.457072 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 11:08:02.457428 20196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.447967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:35047)
0811 11:08:02.448153 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.448198 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.448722 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.448993 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.448998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.449830 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:02.450134 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.450143 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.450959 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.450960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.451727 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.451729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.452076 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.452076 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.452180 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.452670 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:02.452678 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:02.454062 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:02.455954 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.455961 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.455962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.456196 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.456419 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.456419 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.456420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.456524 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.456770 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:02.456776 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:02.456889 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.456974 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.457094 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260811 11:08:02.457983 20189 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35301
I20260811 11:08:02.458086 20189 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:02.458237 20189 heartbeater.cc:511] Master 127.25.227.62:35301 requested a full tablet report, sending...
I20260811 11:08:02.458645 19330 ts_manager.cc:194] Registered new tserver with Master: 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
I20260811 11:08:02.459057 19330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:35047
I20260811 11:08:02.461311 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:08:02.468708 19399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.462666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55810 (local address 127.25.227.62:35301)
0811 11:08:02.462746 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.462748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.462850 (+ 102us) server_negotiation.cc:407] Connection header received
0811 11:08:02.462899 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.462900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.462910 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.462952 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:02.463565 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.464034 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.464835 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.465011 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.465063 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.466414 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:02.466416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:02.466416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:02.466421 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:02.467663 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.468005 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.468006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.468006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.468060 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.468237 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.468237 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.468237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.468382 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:02.468459 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.468583 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.468643 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:08:02.470507 19330 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:08:02.472098 19330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:08:02.479405 20223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.475100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59130 (local address 127.25.227.1:32977)
0811 11:08:02.475380 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.475384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.475677 (+ 293us) server_negotiation.cc:407] Connection header received
0811 11:08:02.475721 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.475723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.475738 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.475827 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:02.475935 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.476980 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.478146 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.478933 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.479022 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.479140 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.479277 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.479323 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":111,"threads_started":1}
I20260811 11:08:02.479409 20216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.474850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:32977 (local address 127.0.0.1:59130)
0811 11:08:02.475554 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.475564 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.475614 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.475824 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.475825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.475827 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:02.475862 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.475863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.477075 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.477077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.478045 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.478048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.479029 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.479030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.479129 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.479146 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.479235 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.479304 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":94,"threads_started":1}
I20260811 11:08:02.479411 20210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.474827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:44613 (local address 127.0.0.1:46060)
0811 11:08:02.474991 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.475033 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.475101 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.475455 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.475459 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.475461 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:02.475537 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.475540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.476891 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.476893 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.478233 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.478235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.479116 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.479117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.479170 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.479174 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.479271 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.479307 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":4,"thread_start_us":53,"threads_started":1}
I20260811 11:08:02.479749 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.474927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46060 (local address 127.25.227.2:44613)
0811 11:08:02.475283 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.475288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.475300 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:08:02.475344 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.475346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.475363 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.475449 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:02.475631 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.476781 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.478328 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.479038 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.479106 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.479157 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.479617 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.479665 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":102,"threads_started":1}
I20260811 11:08:02.480335 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.474830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:32953 (local address 127.0.0.1:33134)
0811 11:08:02.475128 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.475141 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.475202 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.475569 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.475570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.475573 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:02.475631 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.475633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.476683 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.476685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.478223 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.478227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.480089 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.480090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.480159 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.480163 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.480208 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.480257 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":85,"thread_start_us":112,"threads_started":1}
I20260811 11:08:02.480489 20220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.475092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33134 (local address 127.25.227.3:32953)
0811 11:08:02.475328 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.475333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.475344 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:08:02.475387 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.475390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.475408 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.475492 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:02.475733 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.476567 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.479202 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.480008 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.480072 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.480346 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.480373 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.480412 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":112,"threads_started":1}
I20260811 11:08:02.480513 19805 tablet_service.cc:1467] Processing CreateTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb (DEFAULT_TABLE table=test-table [id=2b71e5ef72a849eda732d9999037ea08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:02.480715 19565 tablet_service.cc:1467] Processing CreateTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb (DEFAULT_TABLE table=test-table [id=2b71e5ef72a849eda732d9999037ea08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:02.480963 19805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394dd29e0fb949f683ae08efe1a24ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:02.481117 19565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394dd29e0fb949f683ae08efe1a24ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:02.481142 20059 tablet_service.cc:1467] Processing CreateTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb (DEFAULT_TABLE table=test-table [id=2b71e5ef72a849eda732d9999037ea08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:02.481482 20059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 394dd29e0fb949f683ae08efe1a24ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:02.484390 20224 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Bootstrap starting.
I20260811 11:08:02.484597 20227 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Bootstrap starting.
I20260811 11:08:02.484822 20225 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Bootstrap starting.
I20260811 11:08:02.485352 20227 tablet_bootstrap.cc:654] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:02.485352 20224 tablet_bootstrap.cc:654] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:02.485522 20225 tablet_bootstrap.cc:654] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:02.486064 20225 log.cc:824] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:02.486110 20227 log.cc:824] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:02.486110 20224 log.cc:824] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:02.486821 20225 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: No bootstrap required, opened a new log
I20260811 11:08:02.486907 20225 ts_tablet_manager.cc:1397] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:08:02.488219 20225 raft_consensus.cc:348] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.488384 20225 raft_consensus.cc:374] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:02.488440 20225 raft_consensus.cc:729] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34b999217184cd7965d067edb887d7e, State: Initialized, Role: FOLLOWER
I20260811 11:08:02.488561 20225 consensus_queue.cc:260] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.488833 20225 ts_tablet_manager.cc:1428] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:08:02.488911 19685 heartbeater.cc:503] Master 127.25.227.62:35301 was elected leader, sending a full tablet report...
I20260811 11:08:02.489398 20227 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: No bootstrap required, opened a new log
I20260811 11:08:02.489483 20227 ts_tablet_manager.cc:1397] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 11:08:02.489634 20224 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: No bootstrap required, opened a new log
I20260811 11:08:02.489701 20224 ts_tablet_manager.cc:1397] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260811 11:08:02.491675 20227 raft_consensus.cc:348] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.491899 20227 raft_consensus.cc:374] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:02.491951 20227 raft_consensus.cc:729] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3440cc29267e405faf25cd070dd333a8, State: Initialized, Role: FOLLOWER
I20260811 11:08:02.492024 20224 raft_consensus.cc:348] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.492112 20227 consensus_queue.cc:260] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.492193 20224 raft_consensus.cc:374] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:02.492251 20224 raft_consensus.cc:729] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a62090b9a244e0eab924592afa2d30e, State: Initialized, Role: FOLLOWER
I20260811 11:08:02.492441 20227 ts_tablet_manager.cc:1428] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 11:08:02.492391 20224 consensus_queue.cc:260] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.492453 20189 heartbeater.cc:503] Master 127.25.227.62:35301 was elected leader, sending a full tablet report...
I20260811 11:08:02.492753 20224 ts_tablet_manager.cc:1428] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 11:08:02.492781 19929 heartbeater.cc:503] Master 127.25.227.62:35301 was elected leader, sending a full tablet report...
I20260811 11:08:02.534785 20238 raft_consensus.cc:482] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:02.534924 20238 raft_consensus.cc:504] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.535424 20238 leader_election.cc:288] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953), b34b999217184cd7965d067edb887d7e (127.25.227.1:32977)
I20260811 11:08:02.539494 19935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.535575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:32953 (local address 127.25.227.2:60613)
0811 11:08:02.535637 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.535650 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.535695 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.535909 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.535910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.535912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:02.535996 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.535999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.536987 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.536988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.538398 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.538401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.539196 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.539197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.539308 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.539311 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.539363 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.539396 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":59}
I20260811 11:08:02.539502 20223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.535818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:32875 (local address 127.25.227.1:32977)
0811 11:08:02.535881 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.535883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.535956 (+ 73us) server_negotiation.cc:407] Connection header received
0811 11:08:02.535991 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.535992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.535999 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.536063 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:02.536215 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.536905 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.538511 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.539105 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.539188 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.539197 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.539380 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.539426 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:08:02.539502 20220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.535685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:60613 (local address 127.25.227.3:32953)
0811 11:08:02.535768 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.535770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.535782 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:08:02.535813 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.535815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.535826 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.535887 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:02.536078 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.536889 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.538511 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.539105 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.539187 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.539197 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.539384 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.539425 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 11:08:02.539505 20240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.535647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:32977 (local address 127.25.227.2:32875)
0811 11:08:02.535876 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.535887 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.535943 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.536078 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.536078 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.536080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:02.536147 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.536148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.536987 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.536988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.538398 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.538401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.539196 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.539197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.539277 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.539282 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.539343 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.539394 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":116,"thread_start_us":161,"threads_started":1}
W20260811 11:08:02.539994 19933 tablet.cc:2369] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:08:02.539938 20091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394dd29e0fb949f683ae08efe1a24ecb" candidate_uuid: "4a62090b9a244e0eab924592afa2d30e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3440cc29267e405faf25cd070dd333a8" is_pre_election: true
I20260811 11:08:02.539950 19593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394dd29e0fb949f683ae08efe1a24ecb" candidate_uuid: "4a62090b9a244e0eab924592afa2d30e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34b999217184cd7965d067edb887d7e" is_pre_election: true
I20260811 11:08:02.540110 20091 raft_consensus.cc:2454] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a62090b9a244e0eab924592afa2d30e in term 0.
I20260811 11:08:02.540109 19593 raft_consensus.cc:2454] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a62090b9a244e0eab924592afa2d30e in term 0.
I20260811 11:08:02.540349 19727 leader_election.cc:302] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a62090b9a244e0eab924592afa2d30e, b34b999217184cd7965d067edb887d7e; no voters:
I20260811 11:08:02.540552 20238 raft_consensus.cc:2781] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:08:02.540611 20238 raft_consensus.cc:482] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:08:02.540628 20238 raft_consensus.cc:3037] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:02.541486 20238 raft_consensus.cc:504] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.541640 20238 leader_election.cc:288] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [CANDIDATE]: Term 1 election: Requested vote from peers 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953), b34b999217184cd7965d067edb887d7e (127.25.227.1:32977)
I20260811 11:08:02.541822 19593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394dd29e0fb949f683ae08efe1a24ecb" candidate_uuid: "4a62090b9a244e0eab924592afa2d30e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34b999217184cd7965d067edb887d7e"
I20260811 11:08:02.541821 20091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "394dd29e0fb949f683ae08efe1a24ecb" candidate_uuid: "4a62090b9a244e0eab924592afa2d30e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3440cc29267e405faf25cd070dd333a8"
I20260811 11:08:02.541908 20091 raft_consensus.cc:3037] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:02.541914 19593 raft_consensus.cc:3037] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:02.542634 19593 raft_consensus.cc:2454] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a62090b9a244e0eab924592afa2d30e in term 1.
I20260811 11:08:02.542651 20091 raft_consensus.cc:2454] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a62090b9a244e0eab924592afa2d30e in term 1.
I20260811 11:08:02.542821 19727 leader_election.cc:302] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a62090b9a244e0eab924592afa2d30e, b34b999217184cd7965d067edb887d7e; no voters:
I20260811 11:08:02.542930 20238 raft_consensus.cc:2781] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:02.543092 20238 raft_consensus.cc:686] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 1 LEADER]: Becoming Leader. State: Replica: 4a62090b9a244e0eab924592afa2d30e, State: Running, Role: LEADER
I20260811 11:08:02.543195 20238 consensus_queue.cc:237] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.544047 19327 catalog_manager.cc:5495] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a62090b9a244e0eab924592afa2d30e (127.25.227.2). New cstate: current_term: 1 leader_uuid: "4a62090b9a244e0eab924592afa2d30e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } health_report { overall_health: UNKNOWN } } }
I20260811 11:08:02.552814 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.550669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46076 (local address 127.25.227.2:44613)
0811 11:08:02.550745 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.550747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.550760 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:08:02.550789 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.550790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.550806 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.550874 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:02.550984 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.551441 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.552142 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.552330 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.552383 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.552519 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:02.552613 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:08:02.552673 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.552719 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.552736 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:08:02.554620 19593 raft_consensus.cc:1261] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Refusing update from remote peer 4a62090b9a244e0eab924592afa2d30e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:02.554634 20091 raft_consensus.cc:1261] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Refusing update from remote peer 4a62090b9a244e0eab924592afa2d30e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:02.555002 20241 consensus_queue.cc:1035] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:02.555131 20238 consensus_queue.cc:1035] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:02.557885 20250 mvcc.cc:205] Tried to move back new op lower bound from 7317284792541036544 to 7317284792497496064. Current Snapshot: MvccSnapshot[applied={T|T < 7317284792541036544}]
I20260811 11:08:02.558202 20246 mvcc.cc:205] Tried to move back new op lower bound from 7317284792541036544 to 7317284792497496064. Current Snapshot: MvccSnapshot[applied={T|T < 7317284792541036544}]
I20260811 11:08:02.558647 20252 mvcc.cc:205] Tried to move back new op lower bound from 7317284792541036544 to 7317284792497496064. Current Snapshot: MvccSnapshot[applied={T|T < 7317284792541036544}]
I20260811 11:08:02.560602 19330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:02.560683 19330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:02.561510 19330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Sending DeleteTablet for 3 replicas of tablet 394dd29e0fb949f683ae08efe1a24ecb
I20260811 11:08:02.561905 20059 tablet_service.cc:1514] Processing DeleteTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:02 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33134
I20260811 11:08:02.561916 19565 tablet_service.cc:1514] Processing DeleteTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:02 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:59130
I20260811 11:08:02.561923 19805 tablet_service.cc:1514] Processing DeleteTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:02 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:46060
I20260811 11:08:02.562287 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 19435
I20260811 11:08:02.576188 20265 tablet_replica.cc:330] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: stopping tablet replica
I20260811 11:08:02.576392 20265 raft_consensus.cc:2229] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:08:02.576519 20265 raft_consensus.cc:2258] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:02.577786 20262 tablet_replica.cc:330] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: stopping tablet replica
I20260811 11:08:02.577915 20265 ts_tablet_manager.cc:1905] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:02.578033 20262 raft_consensus.cc:2229] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:02.578215 20262 raft_consensus.cc:2258] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:02.578876 20262 ts_tablet_manager.cc:1905] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:02.579783 20265 ts_tablet_manager.cc:1918] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:02.579869 20265 log.cc:1196] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/394dd29e0fb949f683ae08efe1a24ecb
I20260811 11:08:02.580199 20265 ts_tablet_manager.cc:1939] T 394dd29e0fb949f683ae08efe1a24ecb P 4a62090b9a244e0eab924592afa2d30e: Deleting consensus metadata
I20260811 11:08:02.580688 19294 catalog_manager.cc:4841] TS 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): tablet 394dd29e0fb949f683ae08efe1a24ecb (table test-table [id=2b71e5ef72a849eda732d9999037ea08]) successfully deleted
I20260811 11:08:02.581257 20262 ts_tablet_manager.cc:1918] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:02.581341 20262 log.cc:1196] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/394dd29e0fb949f683ae08efe1a24ecb
I20260811 11:08:02.581619 20262 ts_tablet_manager.cc:1939] T 394dd29e0fb949f683ae08efe1a24ecb P 3440cc29267e405faf25cd070dd333a8: Deleting consensus metadata
I20260811 11:08:02.582084 19299 catalog_manager.cc:4841] TS 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): tablet 394dd29e0fb949f683ae08efe1a24ecb (table test-table [id=2b71e5ef72a849eda732d9999037ea08]) successfully deleted
W20260811 11:08:02.583353 19297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:32977 (error 108)
I20260811 11:08:02.583590 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 19695
I20260811 11:08:02.595815 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.595631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:32977 (local address 127.0.0.1:59146)
0811 11:08:02.595695 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.595748 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:32977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 11:08:02.596095 19297 catalog_manager.cc:4584] TS b34b999217184cd7965d067edb887d7e (127.25.227.1:32977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 394dd29e0fb949f683ae08efe1a24ecb: Network error: Client connection negotiation failed: client connection to 127.25.227.1:32977: connect: Connection refused (error 111)
I20260811 11:08:02.610956 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 19938
I20260811 11:08:02.626457 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 19264
I20260811 11:08:02.645033 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35301
--webserver_interface=127.25.227.62
--webserver_port=43997
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:02.733385 20275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:02.733593 20275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:02.733616 20275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:02.734790 20275 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:08:02.734838 20275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:02.734853 20275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:02.734865 20275 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:08:02.734879 20275 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:08:02.736756 20275 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=43997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:02.737046 20275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:02.737353 20275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:02.748466 20285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.748479 20282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.748534 20288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.748710 20275 server_base.cc:1034] running on GCE node
I20260811 11:08:02.748997 20275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:02.749415 20275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:02.750597 20275 hybrid_clock.cc:648] HybridClock initialized: now 1786446482750583 us; error 43 us; skew 500 ppm
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:02.753371 20275 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:08:02.753868 20275 webserver.cc:460] Webserver started at http://127.25.227.62:43997/ using document root <none> and password file <none>
I20260811 11:08:02.754132 20275 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:02.754218 20275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:02.755642 20275 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:02.756319 20304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.756497 20275 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:08:02.756608 20275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "480dfcd0c7d24e2cb93e427f466c9cc5"
format_stamp: "Formatted at 2026-08-11 11:08:01 on dist-test-slave-z8x9"
server_key: "37f30319a5af2bd091f3bda0035a279e"
server_key_iv: "6743587be6fcc2d1ec3d2cf462298853"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.757025 20275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:02.775328 20275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:02.777755 20275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:02.777916 20275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:02.782303 20275 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35301
I20260811 11:08:02.782356 20398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35301 every 8 connection(s)
I20260811 11:08:02.782776 20275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:08:02.784509 20399 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:08:02.785264 20399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap starting.
I20260811 11:08:02.790501 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 20275
I20260811 11:08:02.790877 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:32977
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:35301
--webserver_port=37697
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:08:02.795099 20399 log.cc:824] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:02.797061 20399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:08:02.797436 20399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap complete.
I20260811 11:08:02.799836 20399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:02.800058 20399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480dfcd0c7d24e2cb93e427f466c9cc5, State: Initialized, Role: FOLLOWER
I20260811 11:08:02.800235 20399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:02.800308 20399 raft_consensus.cc:388] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:08:02.800361 20399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:08:02.800412 20399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:08:02.801530 20399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:02.801620 20399 leader_election.cc:302] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 480dfcd0c7d24e2cb93e427f466c9cc5; no voters:
I20260811 11:08:02.801831 20399 leader_election.cc:288] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:08:02.801925 20404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:08:02.802121 20399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:08:02.802138 20404 raft_consensus.cc:686] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 LEADER]: Becoming Leader. State: Replica: 480dfcd0c7d24e2cb93e427f466c9cc5, State: Running, Role: LEADER
I20260811 11:08:02.802345 20404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:02.802619 20405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } } }
I20260811 11:08:02.802686 20405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:02.803068 20419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:08:02.803046 20406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 480dfcd0c7d24e2cb93e427f466c9cc5. Latest consensus state: current_term: 2 leader_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } } }
I20260811 11:08:02.803162 20406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:02.803831 20419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:08:02.803926 20419 catalog_manager.cc:1259] Loaded cluster ID: 1bba46f4f9404e9595d9427fe27fb6f6
I20260811 11:08:02.803951 20419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:08:02.804200 20419 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 11:08:02.809309 20419 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 11:08:02.812177 20419 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:08:02.812388 20419 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Loaded TSK: 0
I20260811 11:08:02.812616 20419 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:08:02.879269 20402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:02.879475 20402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:02.879499 20402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:02.880654 20402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:02.880697 20402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:02.880723 20402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:08:02.882220 20402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:32977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=37697
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:02.882473 20402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:02.882714 20402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:02.887977 20452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:02.888003 20454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.888115 20402 server_base.cc:1034] running on GCE node
W20260811 11:08:02.887984 20456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:02.888454 20402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:02.888733 20402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:02.889918 20402 hybrid_clock.cc:648] HybridClock initialized: now 1786446482889894 us; error 41 us; skew 500 ppm
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:02.892765 20402 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:08:02.893335 20402 webserver.cc:460] Webserver started at http://127.25.227.1:37697/ using document root <none> and password file <none>
I20260811 11:08:02.893659 20402 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:02.893750 20402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:02.895460 20402 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:08:02.896226 20467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:02.896442 20402 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:02.896540 20402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "b34b999217184cd7965d067edb887d7e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "c188a8d42e3e14a0206aacfe26fd87fd"
server_key_iv: "079a77a6c4d4f070a9b62454a23b1b32"
server_key_version: "encryptionkey@0"
I20260811 11:08:02.897037 20402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:02.908985 20402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:02.911628 20402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:02.911792 20402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:02.912037 20402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:02.912564 20479 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:08:02.914081 20402 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:08:02.914144 20402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 11:08:02.914178 20402 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:08:02.915027 20402 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:08:02.915078 20402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 11:08:02.915161 20479 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Bootstrap starting.
I20260811 11:08:02.922856 20402 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:32977
I20260811 11:08:02.923128 20679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:32977 every 8 connection(s)
I20260811 11:08:02.923317 20402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:08:02.926412 20479 log.cc:824] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:02.927630 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 20402
I20260811 11:08:02.927950 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:44613
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:35301
--webserver_port=42921
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:08:02.929380 20479 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:08:02.929679 20479 tablet_bootstrap.cc:492] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Bootstrap complete.
I20260811 11:08:02.931026 20479 ts_tablet_manager.cc:1397] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.008s
I20260811 11:08:02.932421 20479 raft_consensus.cc:348] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.932682 20479 raft_consensus.cc:729] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34b999217184cd7965d067edb887d7e, State: Initialized, Role: FOLLOWER
I20260811 11:08:02.932857 20479 consensus_queue.cc:260] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:02.933203 20479 ts_tablet_manager.cc:1428] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:02.940904 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.924431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:51153 (local address 127.25.227.62:35301)
0811 11:08:02.926653 (+ 2222us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.926663 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.926705 (+ 42us) server_negotiation.cc:407] Connection header received
0811 11:08:02.926824 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.926829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.926871 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.927016 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:02.927820 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.929259 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.930751 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.931332 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.931942 (+ 610us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.937281 (+ 5339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:02.937291 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:02.937292 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:02.937304 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:02.939083 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.939553 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.939556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.939557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.939663 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.939930 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.939931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.939931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.940176 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:02.940276 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.940577 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.940704 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2150,"thread_start_us":82,"threads_started":1}
I20260811 11:08:02.940904 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.924090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:51153)
0811 11:08:02.924301 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.924364 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.925205 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.927069 (+ 1864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.927073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.927419 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:02.927676 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.927683 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.929394 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.929395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.930628 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.930631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.931475 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.931476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.931636 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.932310 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:02.932319 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:02.934201 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:02.939205 (+ 5004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.939214 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.939216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.939461 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.939742 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.939743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.939743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.939862 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.940254 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:02.940261 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:02.940403 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.940509 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.940703 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260811 11:08:02.941855 20681 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35301
I20260811 11:08:02.941978 20681 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:02.942163 20681 heartbeater.cc:511] Master 127.25.227.62:35301 requested a full tablet report, sending...
I20260811 11:08:02.942886 20332 ts_manager.cc:194] Registered new tserver with Master: b34b999217184cd7965d067edb887d7e (127.25.227.1:32977)
I20260811 11:08:02.944067 20332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:51153
I20260811 11:08:02.944999 20681 heartbeater.cc:503] Master 127.25.227.62:35301 was elected leader, sending a full tablet report...
Aug 11 11:08:02 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446482, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.1@KRBTEST.COM
I20260811 11:08:02.952023 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.943727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.25.227.1:32977)
0811 11:08:02.944078 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:02.944083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:02.944092 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:08:02.944124 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:02.944126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:02.944230 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:02.944300 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:02.944919 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.945874 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.946616 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.946920 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.947002 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.949021 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:02.949029 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:02.949029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:02.949036 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:02.950712 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.951125 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.951128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.951129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.951195 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:02.951406 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:02.951407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:02.951408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:02.951558 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:02.951664 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:02.951836 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 11:08:02.951927 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":65,"threads_started":1}
I20260811 11:08:02.952023 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:02.943484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:32977 (local address 127.0.0.1:59162)
0811 11:08:02.943866 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:02.943901 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:02.943962 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:02.944442 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:02.944446 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:02.944765 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:02.944823 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.944826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.945964 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.945965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.946529 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:02.946531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:02.947002 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:02.947003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:02.947090 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:02.947591 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:02.947596 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:02.948926 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:02.950820 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.950828 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.950830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.951037 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.951273 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:02.951274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:02.951274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:02.951341 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:02.951632 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:02.951640 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:02.951692 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 11:08:02.951798 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:08:02.951922 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":94,"threads_started":1}
I20260811 11:08:02.952735 20559 tablet_service.cc:1514] Processing DeleteTablet for tablet 394dd29e0fb949f683ae08efe1a24ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:02 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:59162
I20260811 11:08:02.953243 20699 tablet_replica.cc:330] stopping tablet replica
I20260811 11:08:02.953369 20699 raft_consensus.cc:2229] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:02.953433 20699 raft_consensus.cc:2258] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:02.953764 20699 ts_tablet_manager.cc:1905] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:02.956050 20699 ts_tablet_manager.cc:1918] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:02.956138 20699 log.cc:1196] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/394dd29e0fb949f683ae08efe1a24ecb
I20260811 11:08:02.956377 20699 ts_tablet_manager.cc:1939] T 394dd29e0fb949f683ae08efe1a24ecb P b34b999217184cd7965d067edb887d7e: Deleting consensus metadata
I20260811 11:08:02.956935 20309 catalog_manager.cc:4841] TS b34b999217184cd7965d067edb887d7e (127.25.227.1:32977): tablet 394dd29e0fb949f683ae08efe1a24ecb (table test-table [id=2b71e5ef72a849eda732d9999037ea08]) successfully deleted
W20260811 11:08:03.021484 20690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:03.021688 20690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:03.021711 20690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:03.022876 20690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:03.022921 20690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:03.022948 20690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:08:03.024400 20690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:44613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=42921
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:03.024647 20690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:03.024896 20690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:03.030565 20710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.030622 20712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.030763 20690 server_base.cc:1034] running on GCE node
W20260811 11:08:03.030565 20716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.031064 20690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:03.031320 20690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:03.032467 20690 hybrid_clock.cc:648] HybridClock initialized: now 1786446483032448 us; error 41 us; skew 500 ppm
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:03.035036 20690 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:08:03.035544 20690 webserver.cc:460] Webserver started at http://127.25.227.2:42921/ using document root <none> and password file <none>
I20260811 11:08:03.035772 20690 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:03.035851 20690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:03.037320 20690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.037971 20729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.038156 20690 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:08:03.038246 20690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "4a62090b9a244e0eab924592afa2d30e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "b7f8e05848b00950d39d451dfc044f99"
server_key_iv: "e9278dd06d77617e8da0c66a679fc970"
server_key_version: "encryptionkey@0"
I20260811 11:08:03.038579 20690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:03.051923 20690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:03.054186 20690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:03.054347 20690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:03.054574 20690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:03.054881 20690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:03.054915 20690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.054957 20690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:03.054986 20690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.061324 20690 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:44613
I20260811 11:08:03.061385 20971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:44613 every 8 connection(s)
I20260811 11:08:03.061769 20690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:08:03.066957 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 20690
I20260811 11:08:03.067235 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:32953
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:35301
--webserver_port=45335
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:03.071451 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.062490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:58425 (local address 127.25.227.62:35301)
0811 11:08:03.062538 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.062541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.062749 (+ 208us) server_negotiation.cc:407] Connection header received
0811 11:08:03.063296 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.063297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.063310 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.063366 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:03.064326 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.064833 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.065845 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.066056 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.066143 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.068397 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:03.068399 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:03.068399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:03.068407 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:03.069962 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:03.070470 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:03.070471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:03.070471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:03.070526 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:03.070831 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:03.070832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:03.070832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:03.070934 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:03.070986 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.071310 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.071384 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:08:03.071848 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.062461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:58425)
0811 11:08:03.062600 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.062658 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.063181 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.063432 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:03.063436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:03.064024 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:03.064211 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.064216 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.064938 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.064939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.065741 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.065743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.066156 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.066157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.066291 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.066822 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:03.066830 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:03.068296 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:03.070048 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:03.070055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:03.070057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:03.070389 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:03.070591 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:03.070592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:03.070592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:03.070743 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:03.070999 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:03.071006 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:03.071173 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 11:08:03.071291 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 11:08:03.071470 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260811 11:08:03.072387 20975 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35301
I20260811 11:08:03.072499 20975 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:03.072729 20975 heartbeater.cc:511] Master 127.25.227.62:35301 requested a full tablet report, sending...
I20260811 11:08:03.073205 20332 ts_manager.cc:194] Registered new tserver with Master: 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613)
I20260811 11:08:03.073585 20332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:58425
W20260811 11:08:03.152426 20978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:03.152621 20978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:03.152644 20978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:03.153851 20978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:03.153898 20978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:03.153924 20978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:08:03.155476 20978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:32953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=45335
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:03.155723 20978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:03.155974 20978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:03.161147 20995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.161237 21002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.161244 20997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.161484 20978 server_base.cc:1034] running on GCE node
I20260811 11:08:03.161743 20978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:03.162053 20978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:03.163232 20978 hybrid_clock.cc:648] HybridClock initialized: now 1786446483163214 us; error 30 us; skew 500 ppm
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:03.165846 20978 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:08:03.166309 20978 webserver.cc:460] Webserver started at http://127.25.227.3:45335/ using document root <none> and password file <none>
I20260811 11:08:03.166572 20978 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:03.166666 20978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:03.167996 20978 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.168604 21016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.168781 20978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.168889 20978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "3440cc29267e405faf25cd070dd333a8"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "e089fb19da707669a7c895b0837fbb3d"
server_key_iv: "711cdec7847411cf3c2e00bd323341c9"
server_key_version: "encryptionkey@0"
I20260811 11:08:03.169312 20978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:03.210639 20978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:03.213264 20978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:03.213415 20978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:03.213682 20978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:03.214036 20978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:03.214075 20978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.214099 20978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:03.214111 20978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.220283 20978 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:32953
I20260811 11:08:03.220364 21242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:32953 every 8 connection(s)
I20260811 11:08:03.220729 20978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:08:03.224125 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 20978
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:03.231678 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.221561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:57845 (local address 127.25.227.62:35301)
0811 11:08:03.221652 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.221655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.221899 (+ 244us) server_negotiation.cc:407] Connection header received
0811 11:08:03.222395 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.222396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.222408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.222468 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:03.223428 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.223936 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.225467 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.225669 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.225750 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.228400 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:03.228401 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:03.228402 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:03.228409 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:03.230088 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:03.230575 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:03.230576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:03.230576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:03.230629 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:03.230911 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:03.230912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:03.230913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:03.231055 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:03.231115 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.231459 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.231562 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 11:08:03.231879 21246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.221540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:57845)
0811 11:08:03.221764 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.221810 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.222297 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.222520 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:03.222523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:03.223112 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:03.223312 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.223316 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.224082 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.224083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.225370 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.225373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.225759 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.225760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.225894 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.226549 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:03.226559 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:03.228301 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:03.230166 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:03.230174 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:03.230177 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:03.230491 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:03.230694 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:03.230695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:03.230695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:03.230841 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:03.231129 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:03.231136 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:03.231313 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 11:08:03.231432 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 11:08:03.231606 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":125,"threads_started":1}
I20260811 11:08:03.232211 21249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.224591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.25.227.62:35301)
0811 11:08:03.224765 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.224767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.224818 (+ 51us) server_negotiation.cc:407] Connection header received
0811 11:08:03.224873 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.224874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.224885 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.224957 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:03.225611 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.226180 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.227229 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.227549 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.227622 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.228834 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:03.228835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:03.228836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:03.228843 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:03.230679 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:03.231043 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:03.231044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:03.231044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:03.231113 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:03.231314 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:03.231315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:03.231315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:03.231453 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:03.231636 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.231679 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.232112 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260811 11:08:03.232422 21243 heartbeater.cc:347] Connected to a master server at 127.25.227.62:35301
I20260811 11:08:03.232542 21243 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:03.232759 21243 heartbeater.cc:511] Master 127.25.227.62:35301 requested a full tablet report, sending...
I20260811 11:08:03.233218 20332 ts_manager.cc:194] Registered new tserver with Master: 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
I20260811 11:08:03.233592 20332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:57845
I20260811 11:08:03.244163 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:08:03.247184 21249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.244568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55824 (local address 127.25.227.62:35301)
0811 11:08:03.244667 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.244670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.244765 (+ 95us) server_negotiation.cc:407] Connection header received
0811 11:08:03.244848 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.244849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.244886 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.244949 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:03.245099 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.245675 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.246428 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.246647 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.246720 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.246852 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:03.246957 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:08:03.247020 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.247052 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.247072 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 11:08:03.247474 20332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:55824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:08:03.249135 20332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:08:03.251477 20559 tablet_service.cc:1467] Processing CreateTablet for tablet 8d44207b550749878a49657dc0e9a656 (DEFAULT_TABLE table=test-table [id=aa26e7fadb104dffaee38a8a2b3fb82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:03.251698 20559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d44207b550749878a49657dc0e9a656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:03.253111 20479 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Bootstrap starting.
I20260811 11:08:03.253494 20479 tablet_bootstrap.cc:654] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:03.254072 20479 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: No bootstrap required, opened a new log
I20260811 11:08:03.254136 20479 ts_tablet_manager.cc:1397] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.254519 20479 raft_consensus.cc:348] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.254614 20479 raft_consensus.cc:374] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:03.254659 20479 raft_consensus.cc:729] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34b999217184cd7965d067edb887d7e, State: Initialized, Role: FOLLOWER
I20260811 11:08:03.254709 20479 consensus_queue.cc:260] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.254796 20479 ts_tablet_manager.cc:1428] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.255460 21251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.251250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:32953 (local address 127.0.0.1:33136)
0811 11:08:03.251463 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.251473 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.251521 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.251899 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:03.251900 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:03.251902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:03.251936 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.251937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.253193 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.253194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.254173 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.254176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.255204 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.255204 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.255261 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.255286 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 11:08:03.255337 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 11:08:03.255382 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":48,"thread_start_us":129,"threads_started":1}
I20260811 11:08:03.255716 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.251535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33136 (local address 127.25.227.3:32953)
0811 11:08:03.251724 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.251728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.251739 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:08:03.251775 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.251777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.251793 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.251901 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:03.251993 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.253061 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.254255 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.255092 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.255201 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.255272 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.255581 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.255629 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260811 11:08:03.256414 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.251172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:44613 (local address 127.0.0.1:46082)
0811 11:08:03.251223 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.251235 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.251274 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.251736 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:03.251738 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:03.251740 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:03.251788 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.251789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.253133 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.253135 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.255063 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.255066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.256174 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.256175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.256257 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.256262 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:08:03.256316 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 11:08:03.256356 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":901}
I20260811 11:08:03.256467 21252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.251320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46082 (local address 127.25.227.2:44613)
0811 11:08:03.251562 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.251567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.251578 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:08:03.251618 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.251620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.251637 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.251726 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:03.251859 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.253002 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.255140 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.256086 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.256163 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.256226 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.256344 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.256384 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":118,"threads_started":1}
I20260811 11:08:03.256498 21118 tablet_service.cc:1467] Processing CreateTablet for tablet 8d44207b550749878a49657dc0e9a656 (DEFAULT_TABLE table=test-table [id=aa26e7fadb104dffaee38a8a2b3fb82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:03.256883 21118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d44207b550749878a49657dc0e9a656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:03.257093 20833 tablet_service.cc:1467] Processing CreateTablet for tablet 8d44207b550749878a49657dc0e9a656 (DEFAULT_TABLE table=test-table [id=aa26e7fadb104dffaee38a8a2b3fb82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:03.257477 20833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d44207b550749878a49657dc0e9a656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:03.260842 21260 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Bootstrap starting.
I20260811 11:08:03.260996 21262 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Bootstrap starting.
I20260811 11:08:03.261634 21260 tablet_bootstrap.cc:654] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:03.261667 21262 tablet_bootstrap.cc:654] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:03.262281 21262 log.cc:824] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:03.262277 21260 log.cc:824] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:03.263125 21262 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: No bootstrap required, opened a new log
I20260811 11:08:03.263135 21260 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: No bootstrap required, opened a new log
I20260811 11:08:03.263204 21262 ts_tablet_manager.cc:1397] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:08:03.263204 21260 ts_tablet_manager.cc:1397] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:08:03.265147 21260 raft_consensus.cc:348] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.265239 21262 raft_consensus.cc:348] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.265354 21260 raft_consensus.cc:374] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:03.265370 21262 raft_consensus.cc:374] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:03.265396 21260 raft_consensus.cc:729] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3440cc29267e405faf25cd070dd333a8, State: Initialized, Role: FOLLOWER
I20260811 11:08:03.265405 21262 raft_consensus.cc:729] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a62090b9a244e0eab924592afa2d30e, State: Initialized, Role: FOLLOWER
I20260811 11:08:03.265523 21260 consensus_queue.cc:260] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.265523 21262 consensus_queue.cc:260] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.265802 21262 ts_tablet_manager.cc:1428] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:08:03.265810 21260 ts_tablet_manager.cc:1428] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 11:08:03.265836 21243 heartbeater.cc:503] Master 127.25.227.62:35301 was elected leader, sending a full tablet report...
I20260811 11:08:03.265959 20975 heartbeater.cc:503] Master 127.25.227.62:35301 was elected leader, sending a full tablet report...
I20260811 11:08:03.287037 21267 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:03.287149 21267 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.287559 21267 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), b34b999217184cd7965d067edb887d7e (127.25.227.1:32977)
I20260811 11:08:03.291486 21252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.287928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35269 (local address 127.25.227.2:44613)
0811 11:08:03.287976 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.287978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.287985 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:08:03.288013 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.288014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.288024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.288074 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:03.288250 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.289027 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.290498 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.291094 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.291179 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.291188 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.291372 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.291413 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:08:03.291487 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.287910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:51375 (local address 127.25.227.1:32977)
0811 11:08:03.287976 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.287978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.287995 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:08:03.288067 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.288068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.288090 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.288149 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:03.288349 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.289076 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.290499 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.291109 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.291179 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.291276 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.291374 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.291418 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:08:03.291497 21246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.287717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:44613 (local address 127.25.227.3:35269)
0811 11:08:03.287774 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.287787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.287826 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.288090 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:03.288091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:03.288092 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:03.288167 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.288169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.289126 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.289128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.290405 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.290408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.291193 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.291194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.291285 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.291291 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 11:08:03.291349 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:08:03.291399 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":46}
I20260811 11:08:03.291507 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.287725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:32977 (local address 127.25.227.3:51375)
0811 11:08:03.287942 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.287951 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.288001 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.288179 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:03.288180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:03.288182 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:03.288249 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.288270 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.289152 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.289153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.290405 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:03.290408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.291193 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.291194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:03.291286 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.291291 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:08:03.291349 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:08:03.291399 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":15,"thread_start_us":121,"threads_started":1}
I20260811 11:08:03.291924 20882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d44207b550749878a49657dc0e9a656" candidate_uuid: "3440cc29267e405faf25cd070dd333a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a62090b9a244e0eab924592afa2d30e" is_pre_election: true
I20260811 11:08:03.292130 20882 raft_consensus.cc:2454] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3440cc29267e405faf25cd070dd333a8 in term 0.
I20260811 11:08:03.292104 20588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d44207b550749878a49657dc0e9a656" candidate_uuid: "3440cc29267e405faf25cd070dd333a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34b999217184cd7965d067edb887d7e" is_pre_election: true
I20260811 11:08:03.292228 20588 raft_consensus.cc:2454] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3440cc29267e405faf25cd070dd333a8 in term 0.
I20260811 11:08:03.292402 21017 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e; no voters:
I20260811 11:08:03.292537 21267 raft_consensus.cc:2781] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:08:03.292594 21267 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:08:03.292621 21267 raft_consensus.cc:3037] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:03.293316 21267 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.293460 21267 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [CANDIDATE]: Term 1 election: Requested vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), b34b999217184cd7965d067edb887d7e (127.25.227.1:32977)
I20260811 11:08:03.293582 20882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d44207b550749878a49657dc0e9a656" candidate_uuid: "3440cc29267e405faf25cd070dd333a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a62090b9a244e0eab924592afa2d30e"
I20260811 11:08:03.293615 20588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d44207b550749878a49657dc0e9a656" candidate_uuid: "3440cc29267e405faf25cd070dd333a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34b999217184cd7965d067edb887d7e"
I20260811 11:08:03.293684 20588 raft_consensus.cc:3037] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:03.293669 20882 raft_consensus.cc:3037] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:03.294589 20588 raft_consensus.cc:2454] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3440cc29267e405faf25cd070dd333a8 in term 1.
I20260811 11:08:03.294589 20882 raft_consensus.cc:2454] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3440cc29267e405faf25cd070dd333a8 in term 1.
I20260811 11:08:03.294767 21017 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e; no voters:
I20260811 11:08:03.294904 21267 raft_consensus.cc:2781] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:03.295042 21267 raft_consensus.cc:686] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 1 LEADER]: Becoming Leader. State: Replica: 3440cc29267e405faf25cd070dd333a8, State: Running, Role: LEADER
I20260811 11:08:03.295207 21267 consensus_queue.cc:237] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.296159 20331 catalog_manager.cc:5495] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3440cc29267e405faf25cd070dd333a8 (127.25.227.3). New cstate: current_term: 1 leader_uuid: "3440cc29267e405faf25cd070dd333a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } health_report { overall_health: UNKNOWN } } }
I20260811 11:08:03.301580 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.299322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33138 (local address 127.25.227.3:32953)
0811 11:08:03.299380 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:03.299382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:03.299390 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:08:03.299427 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:03.299428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:03.299443 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:03.299501 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:03.299596 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.300029 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.300815 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:03.300997 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:03.301053 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:03.301232 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:03.301342 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:08:03.301409 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:03.301446 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 11:08:03.301463 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:08:03.303375 20588 raft_consensus.cc:1261] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Refusing update from remote peer 3440cc29267e405faf25cd070dd333a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:03.303416 20882 raft_consensus.cc:1261] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Refusing update from remote peer 3440cc29267e405faf25cd070dd333a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:03.303722 21273 consensus_queue.cc:1035] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:03.303869 21267 consensus_queue.cc:1035] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:03.309033 20331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:55824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:03.309139 20331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:55824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:03.309892 20331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Sending DeleteTablet for 3 replicas of tablet 8d44207b550749878a49657dc0e9a656
I20260811 11:08:03.310222 21118 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d44207b550749878a49657dc0e9a656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:03 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:33136
I20260811 11:08:03.310298 20559 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d44207b550749878a49657dc0e9a656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:03 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:59162
I20260811 11:08:03.310384 20699 tablet_replica.cc:330] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: stopping tablet replica
I20260811 11:08:03.310441 20699 raft_consensus.cc:2229] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:03.310518 20699 raft_consensus.cc:2258] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:03.310498 20833 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d44207b550749878a49657dc0e9a656 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:03 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:46082
I20260811 11:08:03.310719 21300 tablet_replica.cc:330] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: stopping tablet replica
I20260811 11:08:03.310782 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 20402
I20260811 11:08:03.310884 20699 ts_tablet_manager.cc:1905] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:03.310906 21300 raft_consensus.cc:2229] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:03.311110 21300 raft_consensus.cc:2258] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:03.320259 21297 tablet_replica.cc:330] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: stopping tablet replica
I20260811 11:08:03.320442 21297 raft_consensus.cc:2229] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:08:03.320544 21300 ts_tablet_manager.cc:1905] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:03.320665 21297 raft_consensus.cc:2258] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:03.321151 21297 ts_tablet_manager.cc:1905] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:03.322728 21300 ts_tablet_manager.cc:1918] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:03.322826 21300 log.cc:1196] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/8d44207b550749878a49657dc0e9a656
I20260811 11:08:03.322952 21297 ts_tablet_manager.cc:1918] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:03.323083 21297 log.cc:1196] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/8d44207b550749878a49657dc0e9a656
I20260811 11:08:03.323129 21300 ts_tablet_manager.cc:1939] T 8d44207b550749878a49657dc0e9a656 P 4a62090b9a244e0eab924592afa2d30e: Deleting consensus metadata
I20260811 11:08:03.323479 21297 ts_tablet_manager.cc:1939] T 8d44207b550749878a49657dc0e9a656 P 3440cc29267e405faf25cd070dd333a8: Deleting consensus metadata
I20260811 11:08:03.323935 20310 catalog_manager.cc:4841] TS 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): tablet 8d44207b550749878a49657dc0e9a656 (table test-table [id=aa26e7fadb104dffaee38a8a2b3fb82f]) successfully deleted
I20260811 11:08:03.324036 20308 catalog_manager.cc:4841] TS 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): tablet 8d44207b550749878a49657dc0e9a656 (table test-table [id=aa26e7fadb104dffaee38a8a2b3fb82f]) successfully deleted
W20260811 11:08:03.326802 20309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:32977 (error 108)
I20260811 11:08:03.327277 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 20690
I20260811 11:08:03.327333 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.327183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:32977 (local address 127.0.0.1:59172)
0811 11:08:03.327247 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.327298 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:32977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 11:08:03.330216 20309 catalog_manager.cc:4584] TS b34b999217184cd7965d067edb887d7e (127.25.227.1:32977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8d44207b550749878a49657dc0e9a656: Network error: Client connection negotiation failed: client connection to 127.25.227.1:32977: connect: Connection refused (error 111)
I20260811 11:08:03.338505 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 20978
I20260811 11:08:03.351379 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 20275
I20260811 11:08:03.363428 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35301
--webserver_interface=127.25.227.62
--webserver_port=43997
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:03.446641 21305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:03.446882 21305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:03.446920 21305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:03.448078 21305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:08:03.448154 21305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:03.448180 21305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:03.448205 21305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:08:03.448238 21305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:08:03.449754 21305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=43997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:03.450030 21305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:03.450270 21305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:03.455161 21320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.455253 21305 server_base.cc:1034] running on GCE node
W20260811 11:08:03.455209 21328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.455178 21319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.455637 21305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:03.455965 21305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:03.457139 21305 hybrid_clock.cc:648] HybridClock initialized: now 1786446483457121 us; error 30 us; skew 500 ppm
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:03.459570 21305 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:08:03.460038 21305 webserver.cc:460] Webserver started at http://127.25.227.62:43997/ using document root <none> and password file <none>
I20260811 11:08:03.460285 21305 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:03.460357 21305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:03.461745 21305 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.462415 21340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.462628 21305 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.462706 21305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "480dfcd0c7d24e2cb93e427f466c9cc5"
format_stamp: "Formatted at 2026-08-11 11:08:01 on dist-test-slave-z8x9"
server_key: "37f30319a5af2bd091f3bda0035a279e"
server_key_iv: "6743587be6fcc2d1ec3d2cf462298853"
server_key_version: "encryptionkey@0"
I20260811 11:08:03.462992 21305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:03.472090 21305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:03.474316 21305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:03.474424 21305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:03.478729 21305 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35301
I20260811 11:08:03.478770 21435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35301 every 8 connection(s)
I20260811 11:08:03.479121 21305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:08:03.480629 21437 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:08:03.481304 21437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap starting.
I20260811 11:08:03.488925 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 21305
I20260811 11:08:03.489352 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:32977
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:35301
--webserver_port=37697
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:08:03.490619 21437 log.cc:824] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:03.493934 21437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:08:03.494302 21437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5: Bootstrap complete.
I20260811 11:08:03.498399 21437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:03.498793 21437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480dfcd0c7d24e2cb93e427f466c9cc5, State: Initialized, Role: FOLLOWER
I20260811 11:08:03.498976 21437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:03.499070 21437 raft_consensus.cc:388] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:08:03.499123 21437 raft_consensus.cc:482] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:08:03.499172 21437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 2 FOLLOWER]: Advancing to term 3
I20260811 11:08:03.500746 21437 raft_consensus.cc:504] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:03.500869 21437 leader_election.cc:302] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 480dfcd0c7d24e2cb93e427f466c9cc5; no voters:
I20260811 11:08:03.501052 21437 leader_election.cc:288] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 11:08:03.501119 21445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 11:08:03.501297 21445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [term 3 LEADER]: Becoming Leader. State: Replica: 480dfcd0c7d24e2cb93e427f466c9cc5, State: Running, Role: LEADER
I20260811 11:08:03.501370 21437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:08:03.501397 21445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } }
I20260811 11:08:03.501746 21446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } } }
I20260811 11:08:03.501821 21446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:03.502036 21449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 480dfcd0c7d24e2cb93e427f466c9cc5. Latest consensus state: current_term: 3 leader_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "480dfcd0c7d24e2cb93e427f466c9cc5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35301 } } }
I20260811 11:08:03.502182 21459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:08:03.502205 21449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 480dfcd0c7d24e2cb93e427f466c9cc5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:03.503010 21459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:08:03.503125 21459 catalog_manager.cc:1259] Loaded cluster ID: 1bba46f4f9404e9595d9427fe27fb6f6
I20260811 11:08:03.503177 21459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 11:08:03.503753 21459 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4e7f1b69ad google::LogMessage::Fail() at ??:0
@ 0x7f4e7f1b988a google::LogMessage::SendToLog() at ??:0
@ 0x7f4e7f1b64de google::LogMessage::Flush() at ??:0
@ 0x7f4e7f1b7a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4e870d70f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f4e870e08b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4e810840d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4e81079954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4e81edd6db start_thread at ??:0
@ 0x7f4e7dcb461f clone at ??:0
W20260811 11:08:03.589389 21444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:03.589607 21444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:03.589629 21444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:03.591005 21444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:03.591041 21444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:03.591068 21444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:08:03.592439 21444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:32977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=37697
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:03.592612 21444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:03.592783 21444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:03.598318 21503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.598322 21507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.598568 21504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.598767 21444 server_base.cc:1034] running on GCE node
I20260811 11:08:03.598982 21444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:03.599217 21444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:03.600373 21444 hybrid_clock.cc:648] HybridClock initialized: now 1786446483600360 us; error 26 us; skew 500 ppm
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:03.603087 21444 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:08:03.603528 21444 webserver.cc:460] Webserver started at http://127.25.227.1:37697/ using document root <none> and password file <none>
I20260811 11:08:03.603776 21444 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:03.603816 21444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:03.605508 21444 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.606241 21521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.606410 21444 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.606479 21444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "b34b999217184cd7965d067edb887d7e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "c188a8d42e3e14a0206aacfe26fd87fd"
server_key_iv: "079a77a6c4d4f070a9b62454a23b1b32"
server_key_version: "encryptionkey@0"
I20260811 11:08:03.606793 21444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:03.630659 21444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:03.633118 21444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:03.633318 21444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:03.633574 21444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:03.634115 21539 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:08:03.636513 21444 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:08:03.636587 21444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260811 11:08:03.636626 21444 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:08:03.637363 21444 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:08:03.637419 21444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.637524 21539 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Bootstrap starting.
I20260811 11:08:03.639901 21539 log.cc:824] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:03.643314 21539 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:08:03.643723 21539 tablet_bootstrap.cc:492] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Bootstrap complete.
I20260811 11:08:03.643990 21539 ts_tablet_manager.cc:1397] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 11:08:03.644692 21444 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:32977
I20260811 11:08:03.644788 21722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:32977 every 8 connection(s)
I20260811 11:08:03.645077 21444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:08:03.646775 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 21444
I20260811 11:08:03.647066 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:44613
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:35301
--webserver_port=42921
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:08:03.647182 21539 raft_consensus.cc:348] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.647604 21539 raft_consensus.cc:729] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34b999217184cd7965d067edb887d7e, State: Initialized, Role: FOLLOWER
I20260811 11:08:03.647778 21539 consensus_queue.cc:260] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:03.648087 21539 ts_tablet_manager.cc:1428] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
W20260811 11:08:03.735553 21729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:03.735800 21729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:03.735845 21729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:03.737020 21729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:03.737088 21729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:03.737156 21729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:08:03.738713 21729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:44613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=42921
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:03.738996 21729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:03.739239 21729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:03.745604 21739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.745715 21737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.745626 21743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.746022 21729 server_base.cc:1034] running on GCE node
I20260811 11:08:03.746268 21729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:03.746522 21729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:03.747686 21729 hybrid_clock.cc:648] HybridClock initialized: now 1786446483747662 us; error 37 us; skew 500 ppm
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:03.751044 21729 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:08:03.751507 21729 webserver.cc:460] Webserver started at http://127.25.227.2:42921/ using document root <none> and password file <none>
I20260811 11:08:03.751775 21729 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:03.751858 21729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:03.753293 21729 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:08:03.753978 21761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.754170 21729 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.754276 21729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "4a62090b9a244e0eab924592afa2d30e"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "b7f8e05848b00950d39d451dfc044f99"
server_key_iv: "e9278dd06d77617e8da0c66a679fc970"
server_key_version: "encryptionkey@0"
I20260811 11:08:03.754637 21729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 11:08:03.756716 21726 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:08:03.645864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:35325)
0811 11:08:03.646055 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.646092 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:03.648226 (+ 2134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:03.756495 (+108269us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":120,"threads_started":1}
W20260811 11:08:03.756942 21724 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:35301 (0 consecutive failures): Network error: Failed to ping master at 127.25.227.62:35301: Client connection negotiation failed: client connection to 127.25.227.62:35301: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:08:03.757329 21726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.757164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:60955)
0811 11:08:03.757251 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.757302 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 11:08:03.757613 21726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.757525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:59779)
0811 11:08:03.757570 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.757593 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:08:03.757731 21724 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:08:03.768847 21729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:03.770805 21729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:03.770972 21729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:03.771216 21729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:03.771533 21729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:03.771589 21729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.771636 21729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:03.771668 21729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.777839 21729 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:44613
I20260811 11:08:03.777890 21971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:44613 every 8 connection(s)
I20260811 11:08:03.778220 21729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:08:03.779237 21976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.778866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:58359)
0811 11:08:03.779022 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.779100 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
W20260811 11:08:03.779655 21973 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:35301 (0 consecutive failures): Network error: Failed to ping master at 127.25.227.62:35301: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
I20260811 11:08:03.779953 21976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.779858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:37847)
0811 11:08:03.779909 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.779936 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 11:08:03.780237 21976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.780163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:42329)
0811 11:08:03.780201 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.780223 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 11:08:03.780372 21973 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:08:03.783478 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 21729
I20260811 11:08:03.783732 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:32953
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:35301
--webserver_port=45335
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:03.868019 21979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:03.868221 21979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:03.868244 21979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:03.869347 21979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:03.869383 21979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:03.869410 21979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:08:03.870774 21979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:32953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=45335
--tserver_master_addrs=127.25.227.62:35301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:03.870963 21979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:03.871132 21979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:03.876142 21994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.876184 21991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:03.876188 21990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:03.876430 21979 server_base.cc:1034] running on GCE node
I20260811 11:08:03.876765 21979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:03.877012 21979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:03.878238 21979 hybrid_clock.cc:648] HybridClock initialized: now 1786446483878213 us; error 39 us; skew 500 ppm
Aug 11 11:08:03 dist-test-slave-z8x9 krb5kdc[19246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:03.880851 21979 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:08:03.881448 21979 webserver.cc:460] Webserver started at http://127.25.227.3:45335/ using document root <none> and password file <none>
I20260811 11:08:03.881681 21979 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:03.881752 21979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:03.883116 21979 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:03.883769 22011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.883950 21979 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:08:03.884052 21979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "3440cc29267e405faf25cd070dd333a8"
format_stamp: "Formatted at 2026-08-11 11:08:02 on dist-test-slave-z8x9"
server_key: "e089fb19da707669a7c895b0837fbb3d"
server_key_iv: "711cdec7847411cf3c2e00bd323341c9"
server_key_version: "encryptionkey@0"
I20260811 11:08:03.884413 21979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:03.897310 21979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:03.899375 21979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:03.899535 21979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:03.899777 21979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:03.900098 21979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:03.900156 21979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.900197 21979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:03.900226 21979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:03.906222 21979 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:32953
I20260811 11:08:03.906280 22218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:32953 every 8 connection(s)
I20260811 11:08:03.906615 21979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:08:03.907626 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.907256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:37739)
0811 11:08:03.907405 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.907484 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
W20260811 11:08:03.908049 22222 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:35301 (0 consecutive failures): Network error: Failed to ping master at 127.25.227.62:35301: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
I20260811 11:08:03.908351 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.908257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:55481)
0811 11:08:03.908303 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.908333 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 11:08:03.908627 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:03.908575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:45877)
0811 11:08:03.908595 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:03.908613 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260811 11:08:03.908759 22222 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:08:03.909581 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 21979
I20260811 11:08:04.758388 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:04.758142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:36753)
0811 11:08:04.758291 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:04.758323 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260811 11:08:04.780859 22231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:04.780663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:55651)
0811 11:08:04.780780 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:04.780811 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260811 11:08:04.909351 22233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:04.909081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:58053)
0811 11:08:04.909258 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:04.909295 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":59,"threads_started":1}
I20260811 11:08:05.077479 22234 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:05.077611 22234 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:05.077929 22234 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
Aug 11 11:08:05 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.2@KRBTEST.COM
Aug 11 11:08:05 dist-test-slave-z8x9 krb5kdc[19246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446483, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.3@KRBTEST.COM
I20260811 11:08:05.089121 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.078090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:44613 (local address 127.25.227.1:46517)
0811 11:08:05.078146 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:05.078158 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:05.078228 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:05.079191 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:05.079194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:05.079662 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:05.080191 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:05.080195 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.081318 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.081319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:05.082082 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:05.082085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.082693 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.082694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:05.082824 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:05.083463 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:05.083475 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:05.085225 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:05.087487 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:05.087495 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:05.087497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:05.087775 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:05.088056 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:05.088057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:05.088057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:05.088167 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:05.088563 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:05.088570 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:05.088708 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 11:08:05.088824 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 11:08:05.088996 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":3}
I20260811 11:08:05.089121 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.078246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:46517 (local address 127.25.227.2:44613)
0811 11:08:05.078404 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:05.078417 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:05.078460 (+ 43us) server_negotiation.cc:407] Connection header received
0811 11:08:05.078916 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:05.078918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:05.078960 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:05.079075 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:05.080315 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.081135 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.082177 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.082582 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.082706 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:05.085331 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:05.085341 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:05.085342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:05.085352 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:05.087365 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:05.087860 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:05.087864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:05.087864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:05.087992 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:05.088240 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:05.088241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:05.088242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:05.088489 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:05.088583 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:05.088880 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 11:08:05.089001 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260811 11:08:05.089448 22244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.078303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:37223 (local address 127.25.227.3:32953)
0811 11:08:05.078458 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:05.078472 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:05.078508 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:08:05.078996 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:05.078998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:05.079087 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:05.079234 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:05.080002 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.081075 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.082256 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.082701 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.082833 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:05.085833 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:05.085838 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:05.085838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:05.085857 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:05.087725 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:05.088160 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:05.088164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:05.088164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:05.088266 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:05.088509 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:05.088510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:05.088510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:05.088759 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:05.088860 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:05.089079 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 11:08:05.089354 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
I20260811 11:08:05.089301 22236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.078180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:32953 (local address 127.25.227.1:37223)
0811 11:08:05.078353 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:05.078364 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:05.078441 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:05.079221 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:05.079222 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:05.079653 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:05.079866 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:05.079871 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.081230 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.081231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:05.082085 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:05.082088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:05.082797 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:05.082798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:05.082870 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:05.083522 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:05.083527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:05.085716 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:05.087834 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:05.087835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:05.087836 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:05.088049 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:05.088357 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:05.088358 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:05.088359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:05.088431 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:05.088854 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:05.088855 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:05.088910 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 11:08:05.089007 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 11:08:05.089130 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":42,"thread_start_us":109,"threads_started":1}
W20260811 11:08:05.090662 21525 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
W20260811 11:08:05.090759 21527 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
I20260811 11:08:05.090857 21527 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b34b999217184cd7965d067edb887d7e; no voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e
I20260811 11:08:05.090971 22234 raft_consensus.cc:2726] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:08:05.759081 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.758863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:46975)
0811 11:08:05.758994 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:05.759031 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
I20260811 11:08:05.781509 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.781306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:45621)
0811 11:08:05.781438 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:05.781470 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260811 11:08:05.910035 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:05.909847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:51613)
0811 11:08:05.909962 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:05.909997 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260811 11:08:06.759956 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:06.759669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:36081)
0811 11:08:06.759861 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:06.759905 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":107,"threads_started":1}
I20260811 11:08:06.782095 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:06.781900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:42283)
0811 11:08:06.782021 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:06.782059 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260811 11:08:06.910692 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:06.910455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:56455)
0811 11:08:06.910619 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:06.910650 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260811 11:08:07.133004 22252 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:07.133107 22252 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:07.133349 22252 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
W20260811 11:08:07.133797 21525 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
W20260811 11:08:07.133901 21527 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
I20260811 11:08:07.133975 21527 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b34b999217184cd7965d067edb887d7e; no voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e
I20260811 11:08:07.134068 22252 raft_consensus.cc:2726] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:08:07.760768 22253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:07.760518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:56501)
0811 11:08:07.760673 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:07.760717 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":66,"threads_started":1}
I20260811 11:08:07.782750 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:07.782517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:53675)
0811 11:08:07.782664 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:07.782706 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":67,"threads_started":1}
I20260811 11:08:07.911345 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:07.911123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:37419)
0811 11:08:07.911265 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:07.911304 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260811 11:08:08.761613 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:08.761399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:38191)
0811 11:08:08.761525 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:08.761564 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260811 11:08:08.783466 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:08.783237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:34287)
0811 11:08:08.783392 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:08.783428 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260811 11:08:08.911974 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:08.911780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:51775)
0811 11:08:08.911899 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:08.911931 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260811 11:08:09.762281 22263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:09.762060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:52739)
0811 11:08:09.762192 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:09.762230 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 11:08:09.784124 22264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:09.783919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:43585)
0811 11:08:09.784043 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:09.784079 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260811 11:08:09.816045 22266 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:09.816148 22266 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:09.816321 22266 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
W20260811 11:08:09.816754 21527 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
W20260811 11:08:09.816851 21525 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
I20260811 11:08:09.816946 21525 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b34b999217184cd7965d067edb887d7e; no voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e
I20260811 11:08:09.817018 22266 raft_consensus.cc:2726] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:08:09.912699 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:09.912446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:38925)
0811 11:08:09.912613 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:09.912654 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
I20260811 11:08:10.763091 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:10.762878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:41705)
0811 11:08:10.763004 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:10.763042 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260811 11:08:10.784771 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:10.784559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:33587)
0811 11:08:10.784692 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:10.784730 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260811 11:08:10.913455 22275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:10.913161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:38281)
0811 11:08:10.913374 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:10.913411 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":92,"threads_started":1}
I20260811 11:08:11.763805 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:11.763561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:49333)
0811 11:08:11.763717 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:11.763753 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
I20260811 11:08:11.785454 22278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:11.785245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:47415)
0811 11:08:11.785366 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:11.785407 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260811 11:08:11.914047 22281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:11.913839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:35969)
0811 11:08:11.913968 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:11.914003 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260811 11:08:12.764539 22285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:12.764322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:59205)
0811 11:08:12.764452 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:12.764491 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260811 11:08:12.786048 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:12.785844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:35783)
0811 11:08:12.785973 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:12.786008 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260811 11:08:12.914662 22289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:12.914460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:46265)
0811 11:08:12.914582 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:12.914618 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260811 11:08:13.580894 22290 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:13.581008 22290 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:13.581269 22290 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
W20260811 11:08:13.581604 21527 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
W20260811 11:08:13.581677 21525 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
I20260811 11:08:13.581779 21525 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b34b999217184cd7965d067edb887d7e; no voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e
I20260811 11:08:13.581880 22290 raft_consensus.cc:2726] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:08:13.765287 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:13.765039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:52203)
0811 11:08:13.765193 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:13.765232 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260811 11:08:13.786769 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:13.786516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:46873)
0811 11:08:13.786663 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:13.786724 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260811 11:08:13.915414 22294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:13.915189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:60735)
0811 11:08:13.915330 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:13.915368 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260811 11:08:14.766011 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:14.765737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:45781)
0811 11:08:14.765910 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:14.765954 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":79,"threads_started":1}
I20260811 11:08:14.787607 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:14.787379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:57705)
0811 11:08:14.787532 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:14.787564 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":98,"threads_started":1}
I20260811 11:08:14.916115 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:14.915883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:56031)
0811 11:08:14.916027 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:14.916069 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
I20260811 11:08:15.766842 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:15.766566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:33701)
0811 11:08:15.766731 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:15.766779 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260811 11:08:15.788321 22304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:15.788059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:48819)
0811 11:08:15.788226 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:15.788271 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260811 11:08:15.916837 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:15.916593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:57239)
0811 11:08:15.916750 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:15.916789 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260811 11:08:16.767598 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:16.767265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:37615)
0811 11:08:16.767508 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:16.767548 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":67,"threads_started":1}
I20260811 11:08:16.789031 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:16.788814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:50471)
0811 11:08:16.788948 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:16.788986 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260811 11:08:16.917595 22312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:16.917378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:54743)
0811 11:08:16.917518 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:16.917550 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 11:08:17.016793 22313 raft_consensus.cc:482] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:17.016899 22313 raft_consensus.cc:504] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a62090b9a244e0eab924592afa2d30e" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 44613 } } peers { permanent_uuid: "3440cc29267e405faf25cd070dd333a8" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 32953 } } peers { permanent_uuid: "b34b999217184cd7965d067edb887d7e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 32977 } }
I20260811 11:08:17.017138 22313 leader_election.cc:288] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613), 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953)
W20260811 11:08:17.017566 21525 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a62090b9a244e0eab924592afa2d30e (127.25.227.2:44613): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
W20260811 11:08:17.017663 21527 leader_election.cc:341] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3440cc29267e405faf25cd070dd333a8 (127.25.227.3:32953): Not found: Tablet not found: 8d44207b550749878a49657dc0e9a656
I20260811 11:08:17.017751 21527 leader_election.cc:302] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b34b999217184cd7965d067edb887d7e; no voters: 3440cc29267e405faf25cd070dd333a8, 4a62090b9a244e0eab924592afa2d30e
I20260811 11:08:17.017859 22313 raft_consensus.cc:2726] T 8d44207b550749878a49657dc0e9a656 P b34b999217184cd7965d067edb887d7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:08:17.768352 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:17.768093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:50147)
0811 11:08:17.768259 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:17.768301 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260811 11:08:17.789680 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:17.789453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:56255)
0811 11:08:17.789586 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:17.789626 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 11:08:17.918301 22318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:17.918062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:35329)
0811 11:08:17.918213 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:17.918251 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260811 11:08:18.769205 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:18.768936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.1:34109)
0811 11:08:18.769085 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:18.769118 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260811 11:08:18.790381 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:18.790163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.2:57281)
0811 11:08:18.790305 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:18.790340 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":65,"threads_started":1}
I20260811 11:08:18.910801 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 21444
I20260811 11:08:18.922634 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:18.919907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:35301 (local address 127.25.227.3:54965)
0811 11:08:18.922514 (+ 2607us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:18.922567 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:35301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2581,"thread_start_us":994,"threads_started":1}
I20260811 11:08:18.928361 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 21729
I20260811 11:08:18.944656 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 21979
2026-08-11T11:08:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18599 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:08:19 dist-test-slave-z8x9 krb5kdc[22327](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:08:19 dist-test-slave-z8x9 krb5kdc[22327](info): set up 2 sockets
Aug 11 11:08:19 dist-test-slave-z8x9 krb5kdc[22327](info): commencing operation
krb5kdc: starting...
W20260811 11:08:20.283865 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:08:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:08:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:08:20.406191 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46289
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:46289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:20.489339 22347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:20.489537 22347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:20.489559 22347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:20.490705 22347 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 11:08:20.490756 22347 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 11:08:20.490769 22347 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 11:08:20.490782 22347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:08:20.490823 22347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:20.490850 22347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:20.490867 22347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:08:20.490892 22347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:08:20.492377 22347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:46289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:20.492640 22347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:20.492887 22347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:20.498266 22359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:20.498241 22360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:20.498303 22347 server_base.cc:1034] running on GCE node
W20260811 11:08:20.498246 22363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:20.498807 22347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:20.499109 22347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:20.500280 22347 hybrid_clock.cc:648] HybridClock initialized: now 1786446500500266 us; error 48 us; skew 500 ppm
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:20.502816 22347 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:08:20.503306 22347 webserver.cc:460] Webserver started at http://127.25.227.62:40637/ using document root <none> and password file <none>
I20260811 11:08:20.503557 22347 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:20.503626 22347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:20.503788 22347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:20.504837 22347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "330c9bb8f39445c19c858252520fe4dd"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "b4244d4ae34af6bcfd0e581f316417ae"
server_key_iv: "75d658bd0c1344d1fc35999a7673f85d"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.505259 22347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "330c9bb8f39445c19c858252520fe4dd"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "b4244d4ae34af6bcfd0e581f316417ae"
server_key_iv: "75d658bd0c1344d1fc35999a7673f85d"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.506633 22347 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:08:20.507441 22378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.507650 22347 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:08:20.507773 22347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "330c9bb8f39445c19c858252520fe4dd"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "b4244d4ae34af6bcfd0e581f316417ae"
server_key_iv: "75d658bd0c1344d1fc35999a7673f85d"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.507853 22347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:20.518045 22347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:20.519927 22347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:20.520094 22347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:20.524421 22347 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:46289
I20260811 11:08:20.524456 22466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:46289 every 8 connection(s)
I20260811 11:08:20.524820 22347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:08:20.525774 22468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:20.528132 22468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap starting.
I20260811 11:08:20.528782 22468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:20.529093 22468 log.cc:824] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:20.529860 22468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: No bootstrap required, opened a new log
I20260811 11:08:20.531188 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 22347
I20260811 11:08:20.531296 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:08:20.531515 26508 external_mini_cluster.cc:1428] Setting key 9e0e6760c960dc96d72472351b4e3d84
I20260811 11:08:20.531948 22468 raft_consensus.cc:348] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:20.532146 22468 raft_consensus.cc:374] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:20.532235 22468 raft_consensus.cc:729] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330c9bb8f39445c19c858252520fe4dd, State: Initialized, Role: FOLLOWER
I20260811 11:08:20.532406 22468 consensus_queue.cc:260] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:20.532487 22468 raft_consensus.cc:388] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:08:20.532510 22468 raft_consensus.cc:482] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:08:20.532582 22468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:20.533771 22468 raft_consensus.cc:504] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:20.533866 22468 leader_election.cc:302] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 330c9bb8f39445c19c858252520fe4dd; no voters:
I20260811 11:08:20.534073 22468 leader_election.cc:288] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:08:20.534111 22474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:20.534219 22474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 LEADER]: Becoming Leader. State: Replica: 330c9bb8f39445c19c858252520fe4dd, State: Running, Role: LEADER
I20260811 11:08:20.534392 22468 sys_catalog.cc:564] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:08:20.534364 22474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:20.534912 22477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "330c9bb8f39445c19c858252520fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } } }
I20260811 11:08:20.534950 22479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 330c9bb8f39445c19c858252520fe4dd. Latest consensus state: current_term: 1 leader_uuid: "330c9bb8f39445c19c858252520fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } } }
I20260811 11:08:20.535091 22477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:20.535193 22479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: This master's current role is: LEADER
W20260811 11:08:20.536593 22498 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:08:20.536703 22498 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:08:20.536823 22491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:08:20.537020 22491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:20.539081 22491 catalog_manager.cc:1347] Generated new cluster ID: 0aae8b82ed2a46489c6e6679089ab8c0
I20260811 11:08:20.539134 22491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:08:20.543308 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:20.532130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51106 (local address 127.25.227.62:46289)
0811 11:08:20.532346 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:20.532356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:20.532392 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:08:20.532535 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:20.532542 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:20.532598 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:20.532729 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:20.533639 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.534925 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.536068 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.536481 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.536611 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:20.539499 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:20.539503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:20.539504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:20.539515 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:20.541512 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:20.541898 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:20.541901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:20.541901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:20.542013 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:20.542188 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:20.542189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:20.542189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:20.542456 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:20.542926 (+ 470us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:20.542993 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 11:08:20.543120 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
I20260811 11:08:20.547699 22491 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:08:20.548413 22491 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:08:20.556107 22491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Generated new TSK 0
I20260811 11:08:20.556313 22491 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:08:20.586185 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46289
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:20.674101 22513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:20.674321 22513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:20.674351 22513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:20.675546 22513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:20.675596 22513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:20.675648 22513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:08:20.677146 22513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:20.677456 22513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:20.677707 22513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:20.682806 22532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:20.682813 22534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:20.682950 22513 server_base.cc:1034] running on GCE node
W20260811 11:08:20.683027 22530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:20.683274 22513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:20.683560 22513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:20.684737 22513 hybrid_clock.cc:648] HybridClock initialized: now 1786446500684715 us; error 42 us; skew 500 ppm
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:20.687542 22513 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:08:20.688014 22513 webserver.cc:460] Webserver started at http://127.25.227.1:39407/ using document root <none> and password file <none>
I20260811 11:08:20.688203 22513 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:20.688247 22513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:20.688335 22513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:20.689428 22513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "2e30582c5eac42bb35177a494bcd460e"
server_key_iv: "3cf4beda511d92f59e956e8ea6627de8"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.689754 22513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "2e30582c5eac42bb35177a494bcd460e"
server_key_iv: "3cf4beda511d92f59e956e8ea6627de8"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.691059 22513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:20.691799 22543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.691987 22513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:20.692098 22513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "2e30582c5eac42bb35177a494bcd460e"
server_key_iv: "3cf4beda511d92f59e956e8ea6627de8"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.692180 22513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:20.699280 22513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:20.701329 22513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:20.701490 22513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:20.701735 22513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:20.702054 22513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:20.702108 22513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.702152 22513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:20.702178 22513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.708344 22513 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:36169
I20260811 11:08:20.708420 22741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:36169 every 8 connection(s)
I20260811 11:08:20.708737 22513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:08:20.711549 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 22513
I20260811 11:08:20.711701 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:08:20.711913 26508 external_mini_cluster.cc:1428] Setting key 041a7206748668911f3d506361e76c24
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:20.719741 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:20.709698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:43999 (local address 127.25.227.62:46289)
0811 11:08:20.709742 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:20.709744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:20.709934 (+ 190us) server_negotiation.cc:407] Connection header received
0811 11:08:20.710464 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:20.710465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:20.710486 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:20.710552 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:20.711541 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.712227 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.713470 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.713804 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.713883 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:20.716533 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:20.716534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:20.716535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:20.716544 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:20.718162 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:20.718698 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:20.718700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:20.718700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:20.718766 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:20.719083 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:20.719084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:20.719085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:20.719195 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:20.719249 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:20.719604 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 11:08:20.719677 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 11:08:20.720028 22748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:20.709638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:43999)
0811 11:08:20.709803 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:20.709846 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:20.710334 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:20.710607 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:20.710610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:20.711202 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:20.711417 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:20.711422 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.712345 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.712347 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:20.713384 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:20.713388 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.713896 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.713897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:20.714001 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:20.714615 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:20.714627 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:20.716415 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:20.718245 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:20.718254 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:20.718256 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:20.718597 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:20.718851 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:20.718852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:20.718853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:20.719007 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:20.719266 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:20.719274 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:20.719452 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 11:08:20.719582 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 11:08:20.719783 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260811 11:08:20.720614 22743 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46289
I20260811 11:08:20.720726 22743 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:20.720939 22743 heartbeater.cc:511] Master 127.25.227.62:46289 requested a full tablet report, sending...
I20260811 11:08:20.721537 22405 ts_manager.cc:194] Registered new tserver with Master: 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169)
I20260811 11:08:20.722177 22405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:43999
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:08:20.740681 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46289
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:20.824509 22751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:20.824750 22751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:20.824790 22751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:20.825937 22751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:20.826005 22751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:20.826048 22751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:08:20.827514 22751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:20.827782 22751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:20.828024 22751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:20.833102 22768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:20.833117 22765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:20.833101 22764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:20.833487 22751 server_base.cc:1034] running on GCE node
I20260811 11:08:20.833709 22751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:20.833956 22751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:20.835150 22751 hybrid_clock.cc:648] HybridClock initialized: now 1786446500835143 us; error 38 us; skew 500 ppm
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:20.838055 22751 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:08:20.838549 22751 webserver.cc:460] Webserver started at http://127.25.227.2:36471/ using document root <none> and password file <none>
I20260811 11:08:20.838804 22751 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:20.838876 22751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:20.839025 22751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:20.840047 22751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "fd59f2173c0e41e4877d858492766b4a"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "022c63ac66e3ef86e28e7c317dfbf8ca"
server_key_iv: "21021b4172f82bde090a9d70b9d16691"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.840422 22751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "fd59f2173c0e41e4877d858492766b4a"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "022c63ac66e3ef86e28e7c317dfbf8ca"
server_key_iv: "21021b4172f82bde090a9d70b9d16691"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.841864 22751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:08:20.842948 22778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.843151 22751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:20.843266 22751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "fd59f2173c0e41e4877d858492766b4a"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "022c63ac66e3ef86e28e7c317dfbf8ca"
server_key_iv: "21021b4172f82bde090a9d70b9d16691"
server_key_version: "encryptionkey@0"
I20260811 11:08:20.843340 22751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:20.857234 22751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:20.859194 22751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:20.859370 22751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:20.859622 22751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:20.859931 22751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:20.859985 22751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.860020 22751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:20.860064 22751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:20.865831 22751 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:43811
I20260811 11:08:20.865897 22976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:43811 every 8 connection(s)
I20260811 11:08:20.866195 22751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:20.875027 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:20.866971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:51731 (local address 127.25.227.62:46289)
0811 11:08:20.867062 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:20.867064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:20.867182 (+ 118us) server_negotiation.cc:407] Connection header received
0811 11:08:20.867642 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:20.867643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:20.867654 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:20.867706 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:20.868592 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.869088 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.870082 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.870271 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.870326 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:20.872553 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:20.872554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:20.872554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:20.872560 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:20.873865 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:20.874233 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:20.874234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:20.874235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:20.874292 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:20.874510 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:20.874511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:20.874511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:20.874615 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:20.874665 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:20.874893 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 11:08:20.874961 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 11:08:20.875217 22981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:20.866890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:51731)
0811 11:08:20.867049 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:20.867086 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:20.867555 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:20.867763 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:20.867766 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:20.868327 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:20.868511 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:20.868515 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.869208 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.869210 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:20.870004 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:20.870006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:20.870347 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:20.870348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:20.870448 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:20.871000 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:20.871008 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:20.872463 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:20.873936 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:20.873942 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:20.873944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:20.874165 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:20.874351 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:20.874351 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:20.874352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:20.874453 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:20.874669 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:20.874673 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:20.874785 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 11:08:20.874865 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 11:08:20.874985 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260811 11:08:20.875799 22977 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46289
I20260811 11:08:20.875932 22977 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:20.876159 22977 heartbeater.cc:511] Master 127.25.227.62:46289 requested a full tablet report, sending...
I20260811 11:08:20.876331 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 22751
I20260811 11:08:20.876448 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:08:20.876580 22405 ts_manager.cc:194] Registered new tserver with Master: fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811)
I20260811 11:08:20.876694 26508 external_mini_cluster.cc:1428] Setting key 280649864cc9c5acc8a4561b57d1d2e0
I20260811 11:08:20.877097 22405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:51731
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:08:20.903919 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46289
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:20.987705 22985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:20.987906 22985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:20.987931 22985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:20.989085 22985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:20.989125 22985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:20.989151 22985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:08:20.990561 22985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:20.990741 22985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:20.990911 22985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:20.996083 22998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:20.996068 22993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:20.996053 22995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:20.996309 22985 server_base.cc:1034] running on GCE node
I20260811 11:08:20.996524 22985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:20.996755 22985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:20.997900 22985 hybrid_clock.cc:648] HybridClock initialized: now 1786446500997881 us; error 34 us; skew 500 ppm
Aug 11 11:08:20 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:21.000459 22985 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:08:21.000928 22985 webserver.cc:460] Webserver started at http://127.25.227.3:40579/ using document root <none> and password file <none>
I20260811 11:08:21.001224 22985 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:21.001281 22985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:21.001428 22985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:08:21.002482 22985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
format_stamp: "Formatted at 2026-08-11 11:08:21 on dist-test-slave-z8x9"
server_key: "83c46b9b44717d3343d81b2f2648c274"
server_key_iv: "9ec3f79470b2d2c9d437e07790ff8cf1"
server_key_version: "encryptionkey@0"
I20260811 11:08:21.002838 22985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
format_stamp: "Formatted at 2026-08-11 11:08:21 on dist-test-slave-z8x9"
server_key: "83c46b9b44717d3343d81b2f2648c274"
server_key_iv: "9ec3f79470b2d2c9d437e07790ff8cf1"
server_key_version: "encryptionkey@0"
I20260811 11:08:21.004215 22985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:08:21.004972 23011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:21.005149 22985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:08:21.005307 22985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
format_stamp: "Formatted at 2026-08-11 11:08:21 on dist-test-slave-z8x9"
server_key: "83c46b9b44717d3343d81b2f2648c274"
server_key_iv: "9ec3f79470b2d2c9d437e07790ff8cf1"
server_key_version: "encryptionkey@0"
I20260811 11:08:21.005394 22985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:21.016655 22985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:21.018537 22985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:21.018697 22985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:21.018929 22985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:21.019287 22985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:21.019342 22985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:21.019385 22985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:21.019412 22985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:21.025749 22985 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:33301
I20260811 11:08:21.025802 23219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:33301 every 8 connection(s)
I20260811 11:08:21.026103 22985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:08:21.029413 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 22985
I20260811 11:08:21.029556 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:08:21.029814 26508 external_mini_cluster.cc:1428] Setting key a9ee41b16e5b571969f231050c62e85e
Aug 11 11:08:21 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446500, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:21.036662 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.026857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:48193 (local address 127.25.227.62:46289)
0811 11:08:21.026921 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.026923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.027115 (+ 192us) server_negotiation.cc:407] Connection header received
0811 11:08:21.027663 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.027665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.027679 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.027730 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:21.028671 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.029253 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.030721 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.031109 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.031214 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.033553 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:21.033555 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:21.033555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:21.033562 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:21.035233 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:21.035601 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:21.035601 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:21.035602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:21.035652 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:21.035954 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:21.035955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:21.035956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:21.036080 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:21.036177 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.036472 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.036568 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:08:21.036837 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.026838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:48193)
0811 11:08:21.026998 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.027033 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:21.027545 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:21.027802 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:21.027805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:21.028379 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:21.028570 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.028575 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.029361 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.029362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.030535 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.030538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.031229 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.031230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.031412 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.032026 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:21.032035 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:21.033462 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:21.035305 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:21.035311 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:21.035313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:21.035542 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:21.035747 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:21.035748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:21.035748 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:21.035871 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:21.036169 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:21.036177 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:21.036322 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 11:08:21.036430 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 11:08:21.036593 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260811 11:08:21.037351 23220 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46289
I20260811 11:08:21.037449 23220 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:21.037591 23220 heartbeater.cc:511] Master 127.25.227.62:46289 requested a full tablet report, sending...
I20260811 11:08:21.038054 22403 ts_manager.cc:194] Registered new tserver with Master: cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
I20260811 11:08:21.038452 22403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:48193
I20260811 11:08:21.041663 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:08:21.049006 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.043024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51112 (local address 127.25.227.62:46289)
0811 11:08:21.043091 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.043093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.043225 (+ 132us) server_negotiation.cc:407] Connection header received
0811 11:08:21.043264 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.043265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.043274 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.043311 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:21.043810 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.044256 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.044941 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.045113 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.045161 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.046512 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:21.046513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:21.046513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:21.046519 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:21.047998 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:21.048311 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:21.048312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:21.048312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:21.048367 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:21.048535 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:21.048536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:21.048536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:21.048668 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:21.048745 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.048839 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.048897 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:08:21.050487 22403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:08:21.051954 22403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:08:21.058254 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.054127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33301 (local address 127.0.0.1:58514)
0811 11:08:21.054547 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.054557 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:21.054608 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:21.055020 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:21.055021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:21.055024 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:21.055059 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.055060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.056287 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.056288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.057019 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.057021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.057961 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.057962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.058039 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.058054 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 11:08:21.058130 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:08:21.058177 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260811 11:08:21.058291 23247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.054523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58514 (local address 127.25.227.3:33301)
0811 11:08:21.054723 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.054741 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.054752 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:08:21.054788 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.054790 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.054805 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.054949 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:21.055134 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.056171 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.057111 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.057870 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.057949 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.058008 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.058158 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.058204 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":103,"threads_started":1}
I20260811 11:08:21.058609 23242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.054316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58244 (local address 127.25.227.1:36169)
0811 11:08:21.054530 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.054535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.054780 (+ 245us) server_negotiation.cc:407] Connection header received
0811 11:08:21.054906 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.054909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.054926 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.054983 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:21.055205 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.055891 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.057381 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.058100 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.058186 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.058241 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.058466 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.058513 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":94,"threads_started":1}
I20260811 11:08:21.058794 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.054370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37802 (local address 127.25.227.2:43811)
0811 11:08:21.054548 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.054553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.054564 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:08:21.054607 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.054610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.054626 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.054758 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:21.054954 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.056127 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.057716 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.058441 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.058512 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.058563 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.058682 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.058722 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260811 11:08:21.058785 23236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.054127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:43811 (local address 127.0.0.1:37802)
0811 11:08:21.054245 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.054286 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:21.054355 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:21.054782 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:21.054785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:21.054787 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:21.054855 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.054857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.056235 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.056236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.057627 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.057629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.058515 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.058515 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.058587 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.058590 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:08:21.058667 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:08:21.058708 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":28,"thread_start_us":60,"threads_started":1}
I20260811 11:08:21.058911 23241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.054127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36169 (local address 127.0.0.1:58244)
0811 11:08:21.054711 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.054722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:21.054810 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:21.055096 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:21.055096 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:21.055098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:21.055146 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.055147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.056001 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.056002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.057284 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.057287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.058289 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.058291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.058366 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.058371 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:08:21.058715 (+ 344us) client_negotiation.cc:240] Negotiation successful
0811 11:08:21.058770 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":37,"thread_start_us":60,"threads_started":1}
I20260811 11:08:21.059656 22859 tablet_service.cc:1467] Processing CreateTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 (DEFAULT_TABLE table=test-table [id=df6cbd104fcf41be8039d91bce5dce6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:21.059693 22635 tablet_service.cc:1467] Processing CreateTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 (DEFAULT_TABLE table=test-table [id=df6cbd104fcf41be8039d91bce5dce6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:21.060036 22635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d57fe6f638d4800abee8d42bcf7fe74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:21.060035 22859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d57fe6f638d4800abee8d42bcf7fe74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:21.059983 23101 tablet_service.cc:1467] Processing CreateTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 (DEFAULT_TABLE table=test-table [id=df6cbd104fcf41be8039d91bce5dce6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:21.060272 23101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d57fe6f638d4800abee8d42bcf7fe74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:21.062772 23248 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap starting.
I20260811 11:08:21.063452 23250 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Bootstrap starting.
I20260811 11:08:21.063542 23248 tablet_bootstrap.cc:654] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:21.063681 23254 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Bootstrap starting.
I20260811 11:08:21.064159 23250 tablet_bootstrap.cc:654] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:21.064138 23248 log.cc:824] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:21.064265 23254 tablet_bootstrap.cc:654] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:21.064715 23250 log.cc:824] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:21.064882 23254 log.cc:824] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:21.065019 23248 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: No bootstrap required, opened a new log
I20260811 11:08:21.065119 23248 ts_tablet_manager.cc:1397] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:08:21.065523 23250 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: No bootstrap required, opened a new log
I20260811 11:08:21.065608 23250 ts_tablet_manager.cc:1397] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:08:21.065673 23254 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: No bootstrap required, opened a new log
I20260811 11:08:21.065747 23254 ts_tablet_manager.cc:1397] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:08:21.067137 23250 raft_consensus.cc:348] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.067310 23250 raft_consensus.cc:374] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:21.067358 23250 raft_consensus.cc:729] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb933d9a2e6e4ace9dfcf2c110fc8fa9, State: Initialized, Role: FOLLOWER
I20260811 11:08:21.067346 23248 raft_consensus.cc:348] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.067476 23250 consensus_queue.cc:260] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.067536 23248 raft_consensus.cc:374] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:21.067572 23248 raft_consensus.cc:729] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5ba66f8d464a5c9e8aa2cddf469b46, State: Initialized, Role: FOLLOWER
I20260811 11:08:21.067762 23250 ts_tablet_manager.cc:1428] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:08:21.067709 23248 consensus_queue.cc:260] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.067713 23254 raft_consensus.cc:348] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.067883 23254 raft_consensus.cc:374] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:21.067909 23220 heartbeater.cc:503] Master 127.25.227.62:46289 was elected leader, sending a full tablet report...
I20260811 11:08:21.067935 23254 raft_consensus.cc:729] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd59f2173c0e41e4877d858492766b4a, State: Initialized, Role: FOLLOWER
I20260811 11:08:21.068037 22743 heartbeater.cc:503] Master 127.25.227.62:46289 was elected leader, sending a full tablet report...
I20260811 11:08:21.068037 23254 consensus_queue.cc:260] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.068310 23254 ts_tablet_manager.cc:1428] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:08:21.068389 22977 heartbeater.cc:503] Master 127.25.227.62:46289 was elected leader, sending a full tablet report...
I20260811 11:08:21.068025 23248 ts_tablet_manager.cc:1428] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260811 11:08:21.116766 22980 tablet.cc:2369] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:08:21.209623 22744 tablet.cc:2369] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:08:21.235227 23263 raft_consensus.cc:482] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:21.235384 23263 raft_consensus.cc:504] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.235852 23263 leader_election.cc:288] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169), cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
I20260811 11:08:21.239516 23242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.236151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:54507 (local address 127.25.227.1:36169)
0811 11:08:21.236227 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.236230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.236350 (+ 120us) server_negotiation.cc:407] Connection header received
0811 11:08:21.236404 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.236406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.236417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.236478 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:21.236694 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.237326 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.238720 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.239116 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.239174 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.239182 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.239388 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.239436 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:08:21.239537 22981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.236082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36169 (local address 127.25.227.2:54507)
0811 11:08:21.236192 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.236207 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:21.236301 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:21.236515 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:21.236517 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:21.236519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:21.236608 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.236610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.237408 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.237409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.238602 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.238605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.239209 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.239211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.239305 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.239309 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:08:21.239370 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 11:08:21.239433 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":1}
I20260811 11:08:21.239568 23247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.236243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:57993 (local address 127.25.227.3:33301)
0811 11:08:21.236302 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.236304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.236522 (+ 218us) server_negotiation.cc:407] Connection header received
0811 11:08:21.236579 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.236581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.236594 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.236656 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:21.236824 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.237510 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.238677 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.239175 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.239256 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.239265 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.239439 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.239485 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:08:21.239553 23265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.236082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33301 (local address 127.25.227.2:57993)
0811 11:08:21.236440 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.236451 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:21.236512 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:21.236681 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:21.236682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:21.236684 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:21.236753 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.236754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.237596 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.237597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.238593 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:21.238596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.239279 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.239280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:21.239337 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.239358 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 11:08:21.239417 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:08:21.239453 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":147,"thread_start_us":127,"threads_started":1}
I20260811 11:08:21.239931 22663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d57fe6f638d4800abee8d42bcf7fe74" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" is_pre_election: true
I20260811 11:08:21.240108 22663 raft_consensus.cc:2454] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 0.
I20260811 11:08:21.240038 23135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d57fe6f638d4800abee8d42bcf7fe74" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" is_pre_election: true
I20260811 11:08:21.240238 23135 raft_consensus.cc:2454] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 0.
I20260811 11:08:21.240396 22782 leader_election.cc:302] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5ba66f8d464a5c9e8aa2cddf469b46, fd59f2173c0e41e4877d858492766b4a; no voters:
I20260811 11:08:21.240533 23263 raft_consensus.cc:2781] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:08:21.240592 23263 raft_consensus.cc:482] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:08:21.240625 23263 raft_consensus.cc:3037] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:21.241483 23263 raft_consensus.cc:504] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.241648 23263 leader_election.cc:288] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 election: Requested vote from peers 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169), cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
I20260811 11:08:21.241787 22663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d57fe6f638d4800abee8d42bcf7fe74" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
I20260811 11:08:21.241868 22663 raft_consensus.cc:3037] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:21.241847 23135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d57fe6f638d4800abee8d42bcf7fe74" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
I20260811 11:08:21.241956 23135 raft_consensus.cc:3037] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:21.242745 22663 raft_consensus.cc:2454] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 1.
I20260811 11:08:21.242758 23135 raft_consensus.cc:2454] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 1.
I20260811 11:08:21.242975 22784 leader_election.cc:302] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb933d9a2e6e4ace9dfcf2c110fc8fa9, fd59f2173c0e41e4877d858492766b4a; no voters:
I20260811 11:08:21.243283 23263 raft_consensus.cc:2781] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:21.243458 23263 raft_consensus.cc:686] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 1 LEADER]: Becoming Leader. State: Replica: fd59f2173c0e41e4877d858492766b4a, State: Running, Role: LEADER
I20260811 11:08:21.243564 23263 consensus_queue.cc:237] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:21.244418 22403 catalog_manager.cc:5495] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a reported cstate change: term changed from 0 to 1, leader changed from <none> to fd59f2173c0e41e4877d858492766b4a (127.25.227.2). New cstate: current_term: 1 leader_uuid: "fd59f2173c0e41e4877d858492766b4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } health_report { overall_health: UNKNOWN } } }
W20260811 11:08:21.276768 23223 tablet.cc:2369] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:08:21.287793 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.285509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37818 (local address 127.25.227.2:43811)
0811 11:08:21.285574 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:21.285576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:21.285585 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:08:21.285625 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:21.285626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:21.285646 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:21.285716 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:21.285840 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.286319 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.287037 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:21.287232 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:21.287287 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:21.287421 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:21.287522 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:08:21.287585 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:21.287631 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 11:08:21.287650 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 11:08:21.289845 23135 raft_consensus.cc:1261] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Refusing update from remote peer fd59f2173c0e41e4877d858492766b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:21.289845 22663 raft_consensus.cc:1261] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Refusing update from remote peer fd59f2173c0e41e4877d858492766b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:21.290278 23263 consensus_queue.cc:1035] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:21.290442 23266 consensus_queue.cc:1035] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:21.292724 23272 mvcc.cc:205] Tried to move back new op lower bound from 7317284869279825920 to 7317284869094150144. Current Snapshot: MvccSnapshot[applied={T|T < 7317284869279825920}]
I20260811 11:08:21.293443 23277 mvcc.cc:205] Tried to move back new op lower bound from 7317284869279825920 to 7317284869094150144. Current Snapshot: MvccSnapshot[applied={T|T < 7317284869279825920}]
I20260811 11:08:21.294963 22405 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:21.295056 22405 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:21.295884 22405 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Sending DeleteTablet for 3 replicas of tablet 7d57fe6f638d4800abee8d42bcf7fe74
I20260811 11:08:21.296218 22635 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:21 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:58244
I20260811 11:08:21.296254 22859 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:21 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:37802
I20260811 11:08:21.296470 23298 tablet_replica.cc:330] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: stopping tablet replica
I20260811 11:08:21.296482 23101 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:21 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:58514
I20260811 11:08:21.296578 23298 raft_consensus.cc:2229] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:21.296700 23298 raft_consensus.cc:2258] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:21.296710 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 22513
I20260811 11:08:21.301752 23297 tablet_replica.cc:330] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: stopping tablet replica
I20260811 11:08:21.301905 23297 raft_consensus.cc:2229] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:08:21.302055 23297 raft_consensus.cc:2258] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:21.304549 23297 ts_tablet_manager.cc:1905] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:21.306887 23297 ts_tablet_manager.cc:1918] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:21.306972 23297 log.cc:1196] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/7d57fe6f638d4800abee8d42bcf7fe74
I20260811 11:08:21.307242 23297 ts_tablet_manager.cc:1939] T 7d57fe6f638d4800abee8d42bcf7fe74 P fd59f2173c0e41e4877d858492766b4a: Deleting consensus metadata
I20260811 11:08:21.307674 22379 catalog_manager.cc:4841] TS fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811): tablet 7d57fe6f638d4800abee8d42bcf7fe74 (table test-table [id=df6cbd104fcf41be8039d91bce5dce6c]) successfully deleted
I20260811 11:08:21.311900 23301 tablet_replica.cc:330] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: stopping tablet replica
I20260811 11:08:21.312106 23301 raft_consensus.cc:2229] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:21.312294 23301 raft_consensus.cc:2258] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:21.313561 23301 ts_tablet_manager.cc:1905] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:21.315182 23301 ts_tablet_manager.cc:1918] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:21.315272 23301 log.cc:1196] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/7d57fe6f638d4800abee8d42bcf7fe74
I20260811 11:08:21.315559 23301 ts_tablet_manager.cc:1939] T 7d57fe6f638d4800abee8d42bcf7fe74 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Deleting consensus metadata
I20260811 11:08:21.316041 22384 catalog_manager.cc:4841] TS cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301): tablet 7d57fe6f638d4800abee8d42bcf7fe74 (table test-table [id=df6cbd104fcf41be8039d91bce5dce6c]) successfully deleted
W20260811 11:08:21.319135 22380 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:36169 (error 108)
I20260811 11:08:21.319713 23241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:21.319565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36169 (local address 127.0.0.1:58248)
0811 11:08:21.319629 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:21.319672 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 11:08:21.319792 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 22751
W20260811 11:08:21.327821 22380 catalog_manager.cc:4584] TS 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d57fe6f638d4800abee8d42bcf7fe74: Network error: Client connection negotiation failed: client connection to 127.25.227.1:36169: connect: Connection refused (error 111)
I20260811 11:08:21.334404 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 22985
I20260811 11:08:21.348678 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 22347
I20260811 11:08:41.363592 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46289
--webserver_interface=127.25.227.62
--webserver_port=40637
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:46289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:08:41.450707 23307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:41.450932 23307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:41.450954 23307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:41.452099 23307 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 11:08:41.452144 23307 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 11:08:41.452158 23307 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 11:08:41.452169 23307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:08:41.452183 23307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:41.452226 23307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:41.452263 23307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:08:41.452280 23307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:08:41.453910 23307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:46289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=40637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:41.454192 23307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:41.454449 23307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:41.464151 23316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:41.464151 23319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:41.464188 23317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:41.464506 23307 server_base.cc:1034] running on GCE node
I20260811 11:08:41.464797 23307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:41.465126 23307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:41.466323 23307 hybrid_clock.cc:648] HybridClock initialized: now 1786446521466303 us; error 41 us; skew 500 ppm
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:41.473718 23307 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:08:41.474182 23307 webserver.cc:460] Webserver started at http://127.25.227.62:40637/ using document root <none> and password file <none>
I20260811 11:08:41.474419 23307 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:41.474478 23307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:41.475873 23307 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:08:41.476547 23329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.476745 23307 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:08:41.476852 23307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "330c9bb8f39445c19c858252520fe4dd"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "b4244d4ae34af6bcfd0e581f316417ae"
server_key_iv: "75d658bd0c1344d1fc35999a7673f85d"
server_key_version: "encryptionkey@0"
I20260811 11:08:41.477592 23307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:41.521705 23307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:41.524334 23307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:41.524458 23307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:41.529037 23307 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:46289
I20260811 11:08:41.529105 23427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:46289 every 8 connection(s)
I20260811 11:08:41.529532 23307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:08:41.531191 23429 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:08:41.531250 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 23307
I20260811 11:08:41.531559 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:36169
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:46289
--webserver_port=39407
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:08:41.532052 23429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap starting.
I20260811 11:08:41.544579 23429 log.cc:824] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:41.547609 23429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:08:41.547984 23429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap complete.
I20260811 11:08:41.551481 23429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:41.551816 23429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330c9bb8f39445c19c858252520fe4dd, State: Initialized, Role: FOLLOWER
I20260811 11:08:41.551982 23429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:41.552047 23429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:08:41.552099 23429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:08:41.552146 23429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 1 FOLLOWER]: Advancing to term 2
I20260811 11:08:41.553598 23429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:41.553725 23429 leader_election.cc:302] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 330c9bb8f39445c19c858252520fe4dd; no voters:
I20260811 11:08:41.553906 23429 leader_election.cc:288] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 11:08:41.553996 23434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260811 11:08:41.554210 23429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:08:41.554225 23434 raft_consensus.cc:686] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 LEADER]: Becoming Leader. State: Replica: 330c9bb8f39445c19c858252520fe4dd, State: Running, Role: LEADER
I20260811 11:08:41.554462 23434 consensus_queue.cc:237] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:08:41.554834 23435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "330c9bb8f39445c19c858252520fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } } }
I20260811 11:08:41.554929 23435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:41.555100 23436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 330c9bb8f39445c19c858252520fe4dd. Latest consensus state: current_term: 2 leader_uuid: "330c9bb8f39445c19c858252520fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } } }
I20260811 11:08:41.555197 23436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: This master's current role is: LEADER
I20260811 11:08:41.555696 23452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:08:41.556597 23452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:08:41.556713 23452 catalog_manager.cc:1259] Loaded cluster ID: 0aae8b82ed2a46489c6e6679089ab8c0
I20260811 11:08:41.556746 23452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:08:41.558102 23452 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:08:41.558300 23452 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Loaded TSK: 0
I20260811 11:08:41.567718 23452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Generated new TSK 1
I20260811 11:08:41.567832 23452 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:08:41.629528 23432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:41.629745 23432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:41.629768 23432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:41.630939 23432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:41.630985 23432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:41.631011 23432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:08:41.632522 23432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:36169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=39407
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:41.632781 23432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:41.633041 23432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:41.639259 23485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:41.639442 23432 server_base.cc:1034] running on GCE node
W20260811 11:08:41.639565 23484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:41.639583 23493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:41.639832 23432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:41.640115 23432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:41.641253 23432 hybrid_clock.cc:648] HybridClock initialized: now 1786446521641230 us; error 39 us; skew 500 ppm
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:41.643985 23432 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:08:41.644493 23432 webserver.cc:460] Webserver started at http://127.25.227.1:39407/ using document root <none> and password file <none>
I20260811 11:08:41.644752 23432 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:41.644847 23432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:41.646390 23432 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:41.647166 23507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.647399 23432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:41.647507 23432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "2e30582c5eac42bb35177a494bcd460e"
server_key_iv: "3cf4beda511d92f59e956e8ea6627de8"
server_key_version: "encryptionkey@0"
I20260811 11:08:41.647979 23432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:41.679057 23432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:41.682047 23432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:41.682225 23432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:41.682521 23432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:41.683032 23517 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:08:41.684553 23432 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:08:41.684608 23432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 11:08:41.684643 23432 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:08:41.685405 23432 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:08:41.685451 23432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:41.685513 23517 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap starting.
I20260811 11:08:41.693522 23432 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:36169
I20260811 11:08:41.694073 23432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:08:41.697261 23517 log.cc:824] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:41.697459 23704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:36169 every 8 connection(s)
I20260811 11:08:41.699673 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 23432
I20260811 11:08:41.699986 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:43811
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:46289
--webserver_port=36471
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:08:41.700117 23517 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:08:41.700402 23517 tablet_bootstrap.cc:492] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap complete.
I20260811 11:08:41.701615 23517 ts_tablet_manager.cc:1397] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260811 11:08:41.702899 23517 raft_consensus.cc:348] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:41.703212 23517 raft_consensus.cc:729] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5ba66f8d464a5c9e8aa2cddf469b46, State: Initialized, Role: FOLLOWER
I20260811 11:08:41.703408 23517 consensus_queue.cc:260] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } }
I20260811 11:08:41.703691 23517 ts_tablet_manager.cc:1428] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:41.710500 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.694855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:43313)
0811 11:08:41.697321 (+ 2466us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:41.697376 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:41.698126 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:41.698642 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:41.698647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:41.699020 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:41.699296 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.699303 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.701047 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.701048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.702488 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.702490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.703386 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.703388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.703532 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.704204 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:41.704215 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:41.706039 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:41.708527 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:41.708535 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:41.708536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:41.708772 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:41.709088 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:41.709089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:41.709089 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:41.709482 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:41.710007 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:41.710013 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:41.710128 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 11:08:41.710200 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 11:08:41.710351 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2419,"thread_start_us":98,"threads_started":1}
I20260811 11:08:41.710976 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.694970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:43313 (local address 127.25.227.62:46289)
0811 11:08:41.695171 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:41.695179 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:41.698280 (+ 3101us) server_negotiation.cc:407] Connection header received
0811 11:08:41.698399 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:41.698404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:41.698449 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:41.698545 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:41.699521 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.700901 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.702594 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.703227 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.703368 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.706162 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:41.706168 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:41.706168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:41.706182 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:41.708424 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.708879 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.708883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.708883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.709014 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.709574 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.709575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.709575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.709924 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:41.710022 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:41.710322 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 11:08:41.710489 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":115,"threads_started":1}
I20260811 11:08:41.711741 23708 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46289
I20260811 11:08:41.711869 23708 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:41.712049 23708 heartbeater.cc:511] Master 127.25.227.62:46289 requested a full tablet report, sending...
I20260811 11:08:41.712870 23368 ts_manager.cc:194] Registered new tserver with Master: 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169)
I20260811 11:08:41.714226 23368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:43313
I20260811 11:08:41.715061 23708 heartbeater.cc:503] Master 127.25.227.62:46289 was elected leader, sending a full tablet report...
I20260811 11:08:41.720722 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.713674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53804 (local address 127.25.227.1:36169)
0811 11:08:41.717291 (+ 3617us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:41.717295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:41.717486 (+ 191us) server_negotiation.cc:407] Connection header received
0811 11:08:41.717569 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:41.717571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:41.717585 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:41.717659 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:41.717825 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.718445 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.719930 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.720363 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.720423 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.720458 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:41.720642 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 11:08:41.720671 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3581,"thread_start_us":102,"threads_started":1}
I20260811 11:08:41.720752 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.713643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36169 (local address 127.0.0.1:53804)
0811 11:08:41.717366 (+ 3723us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:41.717406 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:41.717482 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:41.717690 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:41.717693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:41.717695 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:41.717758 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.717760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.718523 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.718523 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.719846 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.719850 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.720446 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.720447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.720533 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.720546 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 11:08:41.720616 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 11:08:41.720675 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3695,"thread_start_us":99,"threads_started":1}
I20260811 11:08:41.721136 23592 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d57fe6f638d4800abee8d42bcf7fe74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:21 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:53804
I20260811 11:08:41.721796 23725 tablet_replica.cc:330] stopping tablet replica
I20260811 11:08:41.721925 23725 raft_consensus.cc:2229] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:41.722005 23725 raft_consensus.cc:2258] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:41.722323 23725 ts_tablet_manager.cc:1905] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:41.724543 23725 ts_tablet_manager.cc:1918] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:41.724651 23725 log.cc:1196] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal/wals/7d57fe6f638d4800abee8d42bcf7fe74
I20260811 11:08:41.724927 23725 ts_tablet_manager.cc:1939] T 7d57fe6f638d4800abee8d42bcf7fe74 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Deleting consensus metadata
I20260811 11:08:41.725507 23335 catalog_manager.cc:4841] TS 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169): tablet 7d57fe6f638d4800abee8d42bcf7fe74 (table test-table [id=df6cbd104fcf41be8039d91bce5dce6c]) successfully deleted
W20260811 11:08:41.796489 23718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:41.796710 23718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:41.796732 23718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:41.798032 23718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:41.798081 23718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:41.798125 23718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:08:41.799633 23718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:43811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=36471
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:41.799904 23718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:41.800164 23718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:41.805469 23736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:41.805507 23731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:41.805506 23733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:41.805814 23718 server_base.cc:1034] running on GCE node
I20260811 11:08:41.806067 23718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:41.806350 23718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:41.807556 23718 hybrid_clock.cc:648] HybridClock initialized: now 1786446521807546 us; error 37 us; skew 500 ppm
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:41.810263 23718 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:08:41.810667 23718 webserver.cc:460] Webserver started at http://127.25.227.2:36471/ using document root <none> and password file <none>
I20260811 11:08:41.810860 23718 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:41.810918 23718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:41.812237 23718 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:41.812857 23748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.813067 23718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:41.813150 23718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "fd59f2173c0e41e4877d858492766b4a"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "022c63ac66e3ef86e28e7c317dfbf8ca"
server_key_iv: "21021b4172f82bde090a9d70b9d16691"
server_key_version: "encryptionkey@0"
I20260811 11:08:41.813537 23718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:41.832603 23718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:41.835193 23718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:41.835316 23718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:41.835526 23718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:41.835810 23718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:41.835842 23718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.835865 23718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:41.835878 23718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.841800 23718 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:43811
I20260811 11:08:41.841903 23941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:43811 every 8 connection(s)
I20260811 11:08:41.842231 23718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:08:41.848063 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 23718
I20260811 11:08:41.848387 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:33301
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:46289
--webserver_port=40579
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:41.852233 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.842982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:43319)
0811 11:08:41.843215 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:41.843267 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:41.843733 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:41.843943 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:41.843947 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:41.844537 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:41.844730 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.844734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.845509 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.845510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.846297 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.846299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.846647 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.846648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.846754 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.847191 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:41.847199 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:41.848880 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:41.850698 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:41.850706 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:41.850709 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:41.851041 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:41.851251 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:41.851252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:41.851253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:41.851422 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:41.851667 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:41.851674 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:41.851840 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 11:08:41.851948 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 11:08:41.852071 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":113,"threads_started":1}
I20260811 11:08:41.852243 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.843016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:43319 (local address 127.25.227.62:46289)
0811 11:08:41.843108 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:41.843110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:41.843359 (+ 249us) server_negotiation.cc:407] Connection header received
0811 11:08:41.843823 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:41.843824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:41.843835 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:41.843888 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:41.844822 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.845430 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.846373 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.846570 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.846620 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.848978 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:41.848980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:41.848980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:41.848989 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:41.850613 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.851121 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.851122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.851123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.851177 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.851489 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.851490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.851490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.851597 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:41.851651 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:41.851997 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 11:08:41.852106 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:08:41.852813 23942 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46289
I20260811 11:08:41.852929 23942 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:41.853118 23942 heartbeater.cc:511] Master 127.25.227.62:46289 requested a full tablet report, sending...
I20260811 11:08:41.853618 23368 ts_manager.cc:194] Registered new tserver with Master: fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811)
I20260811 11:08:41.854204 23368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:43319
W20260811 11:08:41.934036 23946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:08:41.934242 23946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:08:41.934273 23946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:08:41.935355 23946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:08:41.935391 23946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:08:41.935416 23946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:08:41.936774 23946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:33301
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=40579
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:08:41.936965 23946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:08:41.937155 23946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:08:41.942390 23962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:08:41.942431 23960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:41.942451 23946 server_base.cc:1034] running on GCE node
W20260811 11:08:41.942554 23958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:08:41.942806 23946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:08:41.943095 23946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:08:41.944275 23946 hybrid_clock.cc:648] HybridClock initialized: now 1786446521944265 us; error 39 us; skew 500 ppm
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:08:41.946995 23946 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:08:41.947438 23946 webserver.cc:460] Webserver started at http://127.25.227.3:40579/ using document root <none> and password file <none>
I20260811 11:08:41.947669 23946 fs_manager.cc:359] Metadata directory not provided
I20260811 11:08:41.947764 23946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:08:41.949095 23946 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:08:41.949697 23973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.949892 23946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.949986 23946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
format_stamp: "Formatted at 2026-08-11 11:08:21 on dist-test-slave-z8x9"
server_key: "83c46b9b44717d3343d81b2f2648c274"
server_key_iv: "9ec3f79470b2d2c9d437e07790ff8cf1"
server_key_version: "encryptionkey@0"
I20260811 11:08:41.950320 23946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:08:41.969969 23946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:08:41.972050 23946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:08:41.972174 23946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:08:41.972476 23946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:08:41.972828 23946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:08:41.972865 23946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.972888 23946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:08:41.972935 23946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:08:41.979202 23946 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:33301
I20260811 11:08:41.979322 24186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:33301 every 8 connection(s)
I20260811 11:08:41.979646 23946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:08:41 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446521, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:08:41.985765 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 23946
I20260811 11:08:41.989089 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.980532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:43881 (local address 127.25.227.62:46289)
0811 11:08:41.980620 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:41.980627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:41.980843 (+ 216us) server_negotiation.cc:407] Connection header received
0811 11:08:41.981415 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:41.981416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:41.981428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:41.981487 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:41.982417 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.982905 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.983852 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.984039 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.984090 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.986263 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:41.986265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:41.986265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:41.986273 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:41.987697 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.988114 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.988116 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.988116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.988176 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.988432 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.988433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.988434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.988551 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:41.988630 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:41.988914 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 11:08:41.988997 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:08:41.989307 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.980519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:43881)
0811 11:08:41.980689 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:41.980733 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:41.981312 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:41.981542 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:41.981545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:41.982137 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:08:41.982336 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.982340 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.982988 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.982989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.983775 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:41.983777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.984115 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.984116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:41.984217 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.984673 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:08:41.984682 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:08:41.986112 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:08:41.987801 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:41.987808 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:41.987810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:41.988034 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:41.988251 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:08:41.988251 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:08:41.988252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:08:41.988364 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:08:41.988622 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:08:41.988629 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:08:41.988773 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 11:08:41.988878 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:08:41.989038 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260811 11:08:41.989842 24187 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46289
I20260811 11:08:41.989954 24187 heartbeater.cc:464] Registering TS with master...
I20260811 11:08:41.990132 24187 heartbeater.cc:511] Master 127.25.227.62:46289 requested a full tablet report, sending...
I20260811 11:08:41.990577 23368 ts_manager.cc:194] Registered new tserver with Master: cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
I20260811 11:08:41.990954 23368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:43881
I20260811 11:08:41.993094 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.986210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36084 (local address 127.25.227.62:46289)
0811 11:08:41.986529 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:41.986531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:41.986536 (+ 5us) server_negotiation.cc:407] Connection header received
0811 11:08:41.986553 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:41.986553 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:41.986562 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:41.986647 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:41.987264 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.987749 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.988495 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.988695 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.988778 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.990464 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:41.990466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:41.990466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:41.990474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:41.992015 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.992381 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.992382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.992382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.992447 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:41.992617 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:41.992618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:41.992618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:41.992716 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:41.992835 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:41.992884 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 11:08:41.992958 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":66,"threads_started":1}
I20260811 11:08:41.993837 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:08:41.996726 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:41.994244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36088 (local address 127.25.227.62:46289)
0811 11:08:41.994325 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:41.994327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:41.994433 (+ 106us) server_negotiation.cc:407] Connection header received
0811 11:08:41.994520 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:41.994521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:41.994559 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:41.994640 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:41.994740 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.995190 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.995937 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:41.996149 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:41.996228 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:41.996416 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:41.996514 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:08:41.996610 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:41.996628 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 11:08:41.996651 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 11:08:41.996984 23368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:08:41.998661 23368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:08:42.001049 23592 tablet_service.cc:1467] Processing CreateTablet for tablet 956849f7d8644c7696244010c7e21c50 (DEFAULT_TABLE table=test-table [id=f11d0cba97544016890037df69a563d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:42.001310 23592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956849f7d8644c7696244010c7e21c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:42.002651 23517 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap starting.
I20260811 11:08:42.003013 23517 tablet_bootstrap.cc:654] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:42.003597 23517 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: No bootstrap required, opened a new log
I20260811 11:08:42.003647 23517 ts_tablet_manager.cc:1397] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 11:08:42.003769 23517 raft_consensus.cc:348] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.003851 23517 raft_consensus.cc:374] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:42.003908 23517 raft_consensus.cc:729] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5ba66f8d464a5c9e8aa2cddf469b46, State: Initialized, Role: FOLLOWER
I20260811 11:08:42.003953 23517 consensus_queue.cc:260] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.004048 23517 ts_tablet_manager.cc:1428] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 11:08:42.004976 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.000514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:43811 (local address 127.0.0.1:45278)
0811 11:08:42.000559 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:42.000570 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:42.000606 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:42.001119 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:42.001120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:42.001122 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:42.001162 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.001164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.002724 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.002726 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.003695 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.003698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.004728 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.004728 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.004792 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.004796 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:08:42.004858 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 11:08:42.004909 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 11:08:42.005038 24199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.000746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57858 (local address 127.25.227.3:33301)
0811 11:08:42.000936 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.000942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.000954 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:08:42.000995 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.000997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.001013 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.001337 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:42.001450 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.002490 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.003875 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.004618 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.004698 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.004763 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:42.004909 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 11:08:42.004954 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":90,"threads_started":1}
I20260811 11:08:42.005081 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.000702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.25.227.2:43811)
0811 11:08:42.000949 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.000953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.000964 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:08:42.000999 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.001000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.001015 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.001104 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:42.001260 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.002631 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.003863 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.004618 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.004724 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.004785 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:42.004929 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 11:08:42.004973 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":142,"threads_started":1}
I20260811 11:08:42.005440 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.000532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33301 (local address 127.0.0.1:57858)
0811 11:08:42.000631 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:42.000643 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:42.000696 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:42.001129 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:42.001130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:42.001133 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:42.001208 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.001210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.002591 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.002592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.003684 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.003687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.004722 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.004723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.004792 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.004809 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 11:08:42.005123 (+ 314us) client_negotiation.cc:240] Negotiation successful
0811 11:08:42.005390 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":12,"thread_start_us":64,"threads_started":1}
I20260811 11:08:42.005862 23827 tablet_service.cc:1467] Processing CreateTablet for tablet 956849f7d8644c7696244010c7e21c50 (DEFAULT_TABLE table=test-table [id=f11d0cba97544016890037df69a563d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:42.006088 24069 tablet_service.cc:1467] Processing CreateTablet for tablet 956849f7d8644c7696244010c7e21c50 (DEFAULT_TABLE table=test-table [id=f11d0cba97544016890037df69a563d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:08:42.006240 23827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956849f7d8644c7696244010c7e21c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:42.006347 24069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 956849f7d8644c7696244010c7e21c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:08:42.009114 24206 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Bootstrap starting.
I20260811 11:08:42.009363 24209 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Bootstrap starting.
I20260811 11:08:42.009936 24209 tablet_bootstrap.cc:654] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:42.010627 24209 log.cc:824] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:42.010970 24206 tablet_bootstrap.cc:654] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Neither blocks nor log segments found. Creating new log.
I20260811 11:08:42.011402 24209 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: No bootstrap required, opened a new log
I20260811 11:08:42.011490 24209 ts_tablet_manager.cc:1397] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:08:42.011505 24206 log.cc:824] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:08:42.012189 24206 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: No bootstrap required, opened a new log
I20260811 11:08:42.012279 24206 ts_tablet_manager.cc:1397] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:08:42.012924 24209 raft_consensus.cc:348] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.013063 24209 raft_consensus.cc:374] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:42.013085 24209 raft_consensus.cc:729] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd59f2173c0e41e4877d858492766b4a, State: Initialized, Role: FOLLOWER
I20260811 11:08:42.013232 24209 consensus_queue.cc:260] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.013538 24209 ts_tablet_manager.cc:1428] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:08:42.013548 23942 heartbeater.cc:503] Master 127.25.227.62:46289 was elected leader, sending a full tablet report...
I20260811 11:08:42.013967 24206 raft_consensus.cc:348] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.014134 24206 raft_consensus.cc:374] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:08:42.014181 24206 raft_consensus.cc:729] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb933d9a2e6e4ace9dfcf2c110fc8fa9, State: Initialized, Role: FOLLOWER
I20260811 11:08:42.014307 24206 consensus_queue.cc:260] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.014588 24206 ts_tablet_manager.cc:1428] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 11:08:42.014660 24187 heartbeater.cc:503] Master 127.25.227.62:46289 was elected leader, sending a full tablet report...
I20260811 11:08:42.080152 24214 raft_consensus.cc:482] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:08:42.080340 24214 raft_consensus.cc:504] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.080788 24214 leader_election.cc:288] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301), 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169)
I20260811 11:08:42.083626 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.081118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:40163 (local address 127.25.227.1:36169)
0811 11:08:42.081171 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.081173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.081201 (+ 28us) server_negotiation.cc:407] Connection header received
0811 11:08:42.081231 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.081232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.081241 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.081322 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:42.081489 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.081976 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.082891 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.083267 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.083360 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.083370 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:42.083516 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 11:08:42.083556 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:08:42.083624 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.080981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36169 (local address 127.25.227.2:40163)
0811 11:08:42.081062 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:42.081078 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:42.081137 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:42.081327 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:42.081328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:42.081329 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:42.081407 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.081409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.082067 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.082069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.082796 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.082797 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.083357 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.083358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.083439 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.083442 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:08:42.083510 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 11:08:42.083551 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 11:08:42.083786 24199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.081080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:52583 (local address 127.25.227.3:33301)
0811 11:08:42.081239 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.081241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.081288 (+ 47us) server_negotiation.cc:407] Connection header received
0811 11:08:42.081375 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.081376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.081387 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.081476 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:08:42.081649 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.082106 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.083034 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.083432 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.083523 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.083531 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:42.083681 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 11:08:42.083718 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260811 11:08:42.083807 24217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.080999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33301 (local address 127.25.227.2:52583)
0811 11:08:42.081229 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:42.081241 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:08:42.081304 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:08:42.081496 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:08:42.081497 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:08:42.081498 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:08:42.081574 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.081575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.082192 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.082194 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.082938 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:08:42.082940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.083524 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.083525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:08:42.083602 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.083606 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:08:42.083673 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 11:08:42.083714 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":55,"thread_start_us":88,"threads_started":1}
I20260811 11:08:42.083961 23622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956849f7d8644c7696244010c7e21c50" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" is_pre_election: true
I20260811 11:08:42.084120 23622 raft_consensus.cc:2454] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 0.
I20260811 11:08:42.084187 24104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956849f7d8644c7696244010c7e21c50" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" is_pre_election: true
I20260811 11:08:42.084371 24104 raft_consensus.cc:2454] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 0.
I20260811 11:08:42.084378 23752 leader_election.cc:302] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5ba66f8d464a5c9e8aa2cddf469b46, fd59f2173c0e41e4877d858492766b4a; no voters:
I20260811 11:08:42.084556 24214 raft_consensus.cc:2781] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:08:42.084626 24214 raft_consensus.cc:482] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:08:42.084663 24214 raft_consensus.cc:3037] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:42.085511 24214 raft_consensus.cc:504] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.085667 24214 leader_election.cc:288] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 election: Requested vote from peers cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301), 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169)
I20260811 11:08:42.085821 23622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956849f7d8644c7696244010c7e21c50" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
I20260811 11:08:42.085927 23622 raft_consensus.cc:3037] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:42.085947 24104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "956849f7d8644c7696244010c7e21c50" candidate_uuid: "fd59f2173c0e41e4877d858492766b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
I20260811 11:08:42.086030 24104 raft_consensus.cc:3037] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:08:42.086756 24104 raft_consensus.cc:2454] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 1.
I20260811 11:08:42.086961 23754 leader_election.cc:302] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb933d9a2e6e4ace9dfcf2c110fc8fa9, fd59f2173c0e41e4877d858492766b4a; no voters:
I20260811 11:08:42.087064 24214 raft_consensus.cc:2781] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:08:42.087078 23622 raft_consensus.cc:2454] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd59f2173c0e41e4877d858492766b4a in term 1.
I20260811 11:08:42.087236 24214 raft_consensus.cc:686] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 1 LEADER]: Becoming Leader. State: Replica: fd59f2173c0e41e4877d858492766b4a, State: Running, Role: LEADER
I20260811 11:08:42.087350 24214 consensus_queue.cc:237] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:08:42.088243 23368 catalog_manager.cc:5495] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a reported cstate change: term changed from 0 to 1, leader changed from <none> to fd59f2173c0e41e4877d858492766b4a (127.25.227.2). New cstate: current_term: 1 leader_uuid: "fd59f2173c0e41e4877d858492766b4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } health_report { overall_health: UNKNOWN } } }
W20260811 11:08:42.092778 23943 tablet.cc:2369] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:08:42.097687 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.095380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45290 (local address 127.25.227.2:43811)
0811 11:08:42.095440 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.095442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.095449 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:08:42.095484 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.095484 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.095499 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.095570 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:42.095699 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.096151 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.096909 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.097097 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.097210 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.097392 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:42.097434 (+ 42us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 11:08:42.097589 (+ 155us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45290: token expired
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 11:08:42.097764 24201 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45290: token expired
I20260811 11:08:42.104352 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.098026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.25.227.62:46289)
0811 11:08:42.098066 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.098068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.098077 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:08:42.098107 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.098108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.098116 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.098159 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:08:42.098608 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.099162 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.099816 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.099991 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.100040 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.101246 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:08:42.101248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:08:42.101248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:08:42.101255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:08:42.102787 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:42.103351 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:42.103352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:42.103353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:42.103423 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:08:42.103663 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:08:42.103664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:08:42.103664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:08:42.103903 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:08:42.104021 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:42.104166 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 11:08:42.104262 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:08:42.109248 24201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.106817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.25.227.2:43811)
0811 11:08:42.106867 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 11:08:42.106868 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:08:42.106878 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:08:42.106900 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:08:42.106901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:08:42.106912 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:08:42.106969 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:08:42.107104 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.107686 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.108412 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:08:42.108626 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:08:42.108705 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:08:42.108849 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:08:42.108968 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:08:42.109043 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:08:42.109108 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 11:08:42.109131 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:08:42.111107 24104 raft_consensus.cc:1261] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Refusing update from remote peer fd59f2173c0e41e4877d858492766b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:42.111107 23622 raft_consensus.cc:1261] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Refusing update from remote peer fd59f2173c0e41e4877d858492766b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:08:42.111454 24214 consensus_queue.cc:1035] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:42.111605 24219 consensus_queue.cc:1035] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:08:42.114895 24226 mvcc.cc:205] Tried to move back new op lower bound from 7317284954564222976 to 7317284954470510592. Current Snapshot: MvccSnapshot[applied={T|T < 7317284954564222976}]
I20260811 11:08:42.116950 23362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:42.117063 23362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:08:42.117904 23362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Sending DeleteTablet for 3 replicas of tablet 956849f7d8644c7696244010c7e21c50
I20260811 11:08:42.118188 23827 tablet_service.cc:1514] Processing DeleteTablet for tablet 956849f7d8644c7696244010c7e21c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:42 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:45278
I20260811 11:08:42.118237 24069 tablet_service.cc:1514] Processing DeleteTablet for tablet 956849f7d8644c7696244010c7e21c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:08:42 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:57858
I20260811 11:08:42.118294 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 23432
I20260811 11:08:42.118474 24237 tablet_replica.cc:330] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: stopping tablet replica
I20260811 11:08:42.118574 24237 raft_consensus.cc:2229] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:08:42.118690 24237 raft_consensus.cc:2258] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:42.126753 24237 ts_tablet_manager.cc:1905] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:42.129289 24237 ts_tablet_manager.cc:1918] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:42.129400 24237 log.cc:1196] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/956849f7d8644c7696244010c7e21c50
I20260811 11:08:42.129779 24237 ts_tablet_manager.cc:1939] T 956849f7d8644c7696244010c7e21c50 P fd59f2173c0e41e4877d858492766b4a: Deleting consensus metadata
I20260811 11:08:42.130985 23331 catalog_manager.cc:4841] TS fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811): tablet 956849f7d8644c7696244010c7e21c50 (table test-table [id=f11d0cba97544016890037df69a563d8]) successfully deleted
I20260811 11:08:42.137537 24238 tablet_replica.cc:330] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: stopping tablet replica
I20260811 11:08:42.137681 24238 raft_consensus.cc:2229] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:08:42.137799 24238 raft_consensus.cc:2258] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:08:42.139307 24238 ts_tablet_manager.cc:1905] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:08:42.140908 24238 ts_tablet_manager.cc:1918] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:08:42.141026 24238 log.cc:1196] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/956849f7d8644c7696244010c7e21c50
I20260811 11:08:42.141386 24238 ts_tablet_manager.cc:1939] T 956849f7d8644c7696244010c7e21c50 P cb933d9a2e6e4ace9dfcf2c110fc8fa9: Deleting consensus metadata
I20260811 11:08:42.141901 23340 catalog_manager.cc:4841] TS cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301): tablet 956849f7d8644c7696244010c7e21c50 (table test-table [id=f11d0cba97544016890037df69a563d8]) successfully deleted
W20260811 11:08:42.146061 23335 connection.cc:535] client connection to 127.25.227.1:36169 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 11:08:42.146180 23335 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:08:42.146384 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 23718
I20260811 11:08:42.148722 24198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:08:42.146630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36169 (local address 127.0.0.1:53820)
0811 11:08:42.148628 (+ 1998us) negotiation.cc:107] Waiting for socket to connect
0811 11:08:42.148689 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1969}
W20260811 11:08:42.148870 23335 catalog_manager.cc:4584] TS 9a5ba66f8d464a5c9e8aa2cddf469b46 (127.25.227.1:36169): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 956849f7d8644c7696244010c7e21c50: Network error: Client connection negotiation failed: client connection to 127.25.227.1:36169: connect: Connection refused (error 111)
I20260811 11:08:42.159417 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 23946
I20260811 11:08:42.167207 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 23307
I20260811 11:09:02.177333 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46289
--webserver_interface=127.25.227.62
--webserver_port=40637
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:46289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:02.260741 24242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:02.260993 24242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:02.261031 24242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:02.262188 24242 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 11:09:02.262264 24242 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 11:09:02.262285 24242 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 11:09:02.262306 24242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:02.262333 24242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:02.262362 24242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:02.262385 24242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:02.262418 24242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:02.263926 24242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:46289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=40637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:02.264204 24242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:02.264448 24242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:02.269490 24251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:02.269529 24242 server_base.cc:1034] running on GCE node
W20260811 11:09:02.269500 24248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:02.269500 24254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:02.270018 24242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:02.270334 24242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:02.271534 24242 hybrid_clock.cc:648] HybridClock initialized: now 1786446542271519 us; error 31 us; skew 500 ppm
Aug 11 11:09:02 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446542, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:02.276988 24242 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:02.277539 24242 webserver.cc:460] Webserver started at http://127.25.227.62:40637/ using document root <none> and password file <none>
I20260811 11:09:02.277763 24242 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:02.277808 24242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:02.279129 24242 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:02.279785 24268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.279995 24242 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:02.280082 24242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "330c9bb8f39445c19c858252520fe4dd"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "b4244d4ae34af6bcfd0e581f316417ae"
server_key_iv: "75d658bd0c1344d1fc35999a7673f85d"
server_key_version: "encryptionkey@0"
I20260811 11:09:02.280419 24242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:02.304090 24242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:02.306385 24242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:02.306512 24242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:02.310645 24242 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:46289
I20260811 11:09:02.310719 24353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:46289 every 8 connection(s)
I20260811 11:09:02.311121 24242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:02.312636 24354 sys_catalog.cc:263] Verifying existing consensus state
I20260811 11:09:02.313396 24354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap starting.
I20260811 11:09:02.313619 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 24242
I20260811 11:09:02.313905 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:36169
--local_ip_for_outbound_sockets=127.25.227.1
--tserver_master_addrs=127.25.227.62:46289
--webserver_port=39407
--webserver_interface=127.25.227.1
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:09:02.323266 24354 log.cc:824] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:02.326484 24354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:09:02.326867 24354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Bootstrap complete.
I20260811 11:09:02.329710 24354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:09:02.329963 24354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330c9bb8f39445c19c858252520fe4dd, State: Initialized, Role: FOLLOWER
I20260811 11:09:02.330133 24354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:09:02.330216 24354 raft_consensus.cc:388] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:02.330276 24354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:02.330327 24354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 2 FOLLOWER]: Advancing to term 3
I20260811 11:09:02.331723 24354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:09:02.331843 24354 leader_election.cc:302] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 330c9bb8f39445c19c858252520fe4dd; no voters:
I20260811 11:09:02.332068 24354 leader_election.cc:288] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 11:09:02.332106 24359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 3 FOLLOWER]: Leader election won for term 3
I20260811 11:09:02.332233 24359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [term 3 LEADER]: Becoming Leader. State: Replica: 330c9bb8f39445c19c858252520fe4dd, State: Running, Role: LEADER
I20260811 11:09:02.332321 24359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } }
I20260811 11:09:02.332357 24354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:02.332587 24359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 330c9bb8f39445c19c858252520fe4dd. Latest consensus state: current_term: 3 leader_uuid: "330c9bb8f39445c19c858252520fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } } }
I20260811 11:09:02.332664 24359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:02.332590 24369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "330c9bb8f39445c19c858252520fe4dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "330c9bb8f39445c19c858252520fe4dd" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46289 } } }
I20260811 11:09:02.332844 24369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:02.332880 24372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:02.333808 24372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:02.333940 24372 catalog_manager.cc:1259] Loaded cluster ID: 0aae8b82ed2a46489c6e6679089ab8c0
I20260811 11:09:02.334195 24372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:02.335023 24372 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:02.335168 24372 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Loaded TSK: 0
I20260811 11:09:02.335201 24372 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 330c9bb8f39445c19c858252520fe4dd: Loaded TSK: 1
F20260811 11:09:02.335358 24372 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7feece3a49ad google::LogMessage::Fail() at ??:0
@ 0x7feece3a788a google::LogMessage::SendToLog() at ??:0
@ 0x7feece3a44de google::LogMessage::Flush() at ??:0
@ 0x7feece3a5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7feed0b11104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7feed0b0ed41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7feed62fe1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7feed62fe48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7feed62fe594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7feed62c4c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7feed62cead0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7feed02720d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7feed0267954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7feed10cb6db start_thread at ??:0
@ 0x7feeccea261f clone at ??:0
W20260811 11:09:02.425484 24357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:02.425702 24357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:02.425726 24357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:02.426896 24357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:02.426941 24357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:02.426967 24357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:02.428454 24357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:36169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=39407
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:02.428733 24357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:02.428974 24357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:02.434275 24429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:02.434296 24425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:02.434569 24431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:02.434676 24357 server_base.cc:1034] running on GCE node
I20260811 11:09:02.434913 24357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:02.435194 24357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:02.436364 24357 hybrid_clock.cc:648] HybridClock initialized: now 1786446542436354 us; error 28 us; skew 500 ppm
Aug 11 11:09:02 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446542, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:02.439014 24357 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:09:02.439544 24357 webserver.cc:460] Webserver started at http://127.25.227.1:39407/ using document root <none> and password file <none>
I20260811 11:09:02.439798 24357 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:02.439845 24357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:02.441287 24357 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:02.442059 24445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.442231 24357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:02.442337 24357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "2e30582c5eac42bb35177a494bcd460e"
server_key_iv: "3cf4beda511d92f59e956e8ea6627de8"
server_key_version: "encryptionkey@0"
I20260811 11:09:02.442689 24357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:02.463797 24357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:02.466285 24357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:02.466449 24357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:02.466743 24357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:02.467275 24459 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 11:09:02.468807 24357 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 11:09:02.468868 24357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 11:09:02.468895 24357 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 11:09:02.469633 24357 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 11:09:02.469681 24357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 11:09:02.469746 24459 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap starting.
I20260811 11:09:02.477579 24357 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:36169
I20260811 11:09:02.477757 24638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:36169 every 8 connection(s)
I20260811 11:09:02.478132 24357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:09:02.481158 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 24357
I20260811 11:09:02.481487 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:43811
--local_ip_for_outbound_sockets=127.25.227.2
--tserver_master_addrs=127.25.227.62:46289
--webserver_port=36471
--webserver_interface=127.25.227.2
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:09:02.481794 24459 log.cc:824] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:02.484427 24459 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 11:09:02.484776 24459 tablet_bootstrap.cc:492] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Bootstrap complete.
I20260811 11:09:02.485981 24459 ts_tablet_manager.cc:1397] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.012s
I20260811 11:09:02.487828 24459 raft_consensus.cc:348] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:09:02.488225 24459 raft_consensus.cc:729] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5ba66f8d464a5c9e8aa2cddf469b46, State: Initialized, Role: FOLLOWER
I20260811 11:09:02.488400 24459 consensus_queue.cc:260] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:09:02.488729 24459 ts_tablet_manager.cc:1428] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260811 11:09:02.540910 24643 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:02.478882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:46075)
0811 11:09:02.479074 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.479122 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:02.479914 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:02.540686 (+ 60772us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
W20260811 11:09:02.541242 24639 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:46289 (0 consecutive failures): Network error: Failed to ping master at 127.25.227.62:46289: Client connection negotiation failed: client connection to 127.25.227.62:46289: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 11:09:02.541616 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.541494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:60467)
0811 11:09:02.541549 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.541595 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 11:09:02.542021 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.541910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:46915)
0811 11:09:02.541963 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.541993 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 11:09:02.542156 24639 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 11:09:02.573223 24646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:02.573485 24646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:02.573525 24646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:02.574718 24646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:02.574787 24646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:02.574833 24646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:02.576320 24646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:43811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=36471
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:02.576586 24646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:02.576825 24646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:02.582363 24653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:02.582360 24656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:02.582468 24646 server_base.cc:1034] running on GCE node
W20260811 11:09:02.582355 24659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:02.582906 24646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:02.583161 24646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:02.584318 24646 hybrid_clock.cc:648] HybridClock initialized: now 1786446542584297 us; error 41 us; skew 500 ppm
Aug 11 11:09:02 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446542, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:02.586920 24646 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:09:02.587405 24646 webserver.cc:460] Webserver started at http://127.25.227.2:36471/ using document root <none> and password file <none>
I20260811 11:09:02.587627 24646 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:02.587670 24646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:02.588980 24646 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:02.589685 24667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.589874 24646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:09:02.589969 24646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "fd59f2173c0e41e4877d858492766b4a"
format_stamp: "Formatted at 2026-08-11 11:08:20 on dist-test-slave-z8x9"
server_key: "022c63ac66e3ef86e28e7c317dfbf8ca"
server_key_iv: "21021b4172f82bde090a9d70b9d16691"
server_key_version: "encryptionkey@0"
I20260811 11:09:02.590382 24646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:02.603180 24646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:02.605218 24646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:02.605406 24646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:02.605662 24646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:02.605989 24646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:02.606045 24646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.606087 24646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:02.606132 24646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.612576 24646 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:43811
I20260811 11:09:02.612620 24861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:43811 every 8 connection(s)
I20260811 11:09:02.612988 24646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:09:02.614131 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.613723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:41085)
0811 11:09:02.613893 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.613975 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":75,"threads_started":1}
W20260811 11:09:02.614594 24865 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:46289 (0 consecutive failures): Network error: Failed to ping master at 127.25.227.62:46289: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
I20260811 11:09:02.614967 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.614862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:47891)
0811 11:09:02.614915 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.614945 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 11:09:02.615285 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.615197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:50477)
0811 11:09:02.615246 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.615271 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 11:09:02.615412 24865 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:09:02.616122 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 24646
I20260811 11:09:02.616487 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:33301
--local_ip_for_outbound_sockets=127.25.227.3
--tserver_master_addrs=127.25.227.62:46289
--webserver_port=40579
--webserver_interface=127.25.227.3
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:02.705037 24869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:02.705303 24869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:02.705348 24869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:02.706538 24869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:02.706610 24869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:02.706655 24869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:02.708132 24869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:33301
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=40579
--tserver_master_addrs=127.25.227.62:46289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:02.708433 24869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:02.708678 24869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:02.713915 24878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:02.713938 24882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:02.713939 24877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:02.714032 24869 server_base.cc:1034] running on GCE node
I20260811 11:09:02.714336 24869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:02.714578 24869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:02.715728 24869 hybrid_clock.cc:648] HybridClock initialized: now 1786446542715718 us; error 32 us; skew 500 ppm
Aug 11 11:09:02 dist-test-slave-z8x9 krb5kdc[22327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446542, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:02.718434 24869 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:09:02.718874 24869 webserver.cc:460] Webserver started at http://127.25.227.3:40579/ using document root <none> and password file <none>
I20260811 11:09:02.719113 24869 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:02.719159 24869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:02.720474 24869 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:02.721107 24893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.721323 24869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:02.721419 24869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9"
format_stamp: "Formatted at 2026-08-11 11:08:21 on dist-test-slave-z8x9"
server_key: "83c46b9b44717d3343d81b2f2648c274"
server_key_iv: "9ec3f79470b2d2c9d437e07790ff8cf1"
server_key_version: "encryptionkey@0"
I20260811 11:09:02.721743 24869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:02.732020 24869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:02.734493 24869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:02.734648 24869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:02.734907 24869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:02.735240 24869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:02.735298 24869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.735334 24869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:02.735363 24869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:02.741323 24869 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:33301
I20260811 11:09:02.741396 25108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:33301 every 8 connection(s)
I20260811 11:09:02.741818 24869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:09:02.742703 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 24869
I20260811 11:09:02.743221 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.742715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:53465)
0811 11:09:02.742915 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.743014 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
W20260811 11:09:02.743723 25109 heartbeater.cc:644] Failed to heartbeat to 127.25.227.62:46289 (0 consecutive failures): Network error: Failed to ping master at 127.25.227.62:46289: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
I20260811 11:09:02.744040 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.743943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:42837)
0811 11:09:02.743991 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.744016 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 11:09:02.744333 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:02.744241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:50445)
0811 11:09:02.744288 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:02.744311 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 11:09:02.744444 25109 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 11:09:03.542793 25113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.542498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:34143)
0811 11:09:03.542629 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:03.542672 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":101,"threads_started":1}
I20260811 11:09:03.615965 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.615736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:37811)
0811 11:09:03.615885 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:03.615924 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260811 11:09:03.744995 25117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.744772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:51769)
0811 11:09:03.744895 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:03.744944 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":57,"threads_started":1}
I20260811 11:09:03.940451 25119 raft_consensus.cc:482] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:03.940580 25119 raft_consensus.cc:504] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:09:03.940912 25119 leader_election.cc:288] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811), cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
Aug 11 11:09:03 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446542, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.3@KRBTEST.COM
Aug 11 11:09:03 dist-test-slave-z8x9 krb5kdc[22327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446542, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.2@KRBTEST.COM
I20260811 11:09:03.951993 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.941274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:34227 (local address 127.25.227.3:33301)
0811 11:09:03.941443 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:03.941460 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:03.941491 (+ 31us) server_negotiation.cc:407] Connection header received
0811 11:09:03.941963 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:03.941965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:03.942006 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:03.942165 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:03.943095 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.943957 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.945082 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.945576 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.945696 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:03.948186 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:03.948190 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:03.948190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:03.948200 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:03.950169 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:03.950654 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:03.950658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:03.950659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:03.950779 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:03.951068 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:03.951069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:03.951070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:03.951348 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:03.951441 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:03.951740 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 11:09:03.951870 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
I20260811 11:09:03.951979 25113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.941072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:43811 (local address 127.25.227.1:56397)
0811 11:09:03.941115 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:03.941139 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:03.941222 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:03.942213 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:03.942216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:03.942763 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:03.942972 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:03.942978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.944086 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.944087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:03.944957 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:03.944960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.945673 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.945674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:03.945813 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:03.946532 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:03.946536 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:03.948469 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:03.950450 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:03.950450 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:03.950451 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:03.950670 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:03.950964 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:03.950964 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:03.950965 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:03.951023 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:03.951433 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:03.951441 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:03.951565 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 11:09:03.951670 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:09:03.951881 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":23}
I20260811 11:09:03.952009 25123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.941356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:56397 (local address 127.25.227.2:43811)
0811 11:09:03.941521 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:03.941538 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:03.941556 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:09:03.941962 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:03.941964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:03.942006 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:03.942166 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:03.943095 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.943978 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.945044 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.945562 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.945697 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:03.948583 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:03.948592 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:03.948593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:03.948603 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:03.950362 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:03.950756 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:03.950759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:03.950760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:03.950888 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:03.951107 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:03.951107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:03.951108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:03.951347 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:03.951440 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:03.951735 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 11:09:03.951873 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":52,"threads_started":1}
I20260811 11:09:03.952116 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:03.941098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33301 (local address 127.25.227.1:34227)
0811 11:09:03.941225 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:03.941238 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:03.941325 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:03.942215 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:03.942217 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:03.942762 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:03.942971 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:03.942978 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.944065 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.944067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:03.944956 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:03.944959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:03.945681 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:03.945682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:03.945813 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:03.946468 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:03.946477 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:03.948078 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:03.950256 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:03.950265 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:03.950267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:03.950576 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:03.950853 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:03.950853 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:03.950854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:03.950991 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:03.951447 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:03.951448 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:03.951565 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 11:09:03.951670 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 11:09:03.951964 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":221,"thread_start_us":65,"threads_started":1}
W20260811 11:09:03.953269 24447 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
W20260811 11:09:03.953456 24452 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
I20260811 11:09:03.953537 24452 leader_election.cc:302] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5ba66f8d464a5c9e8aa2cddf469b46; no voters: cb933d9a2e6e4ace9dfcf2c110fc8fa9, fd59f2173c0e41e4877d858492766b4a
I20260811 11:09:03.953644 25119 raft_consensus.cc:2726] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:09:04.543526 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:04.543294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:55713)
0811 11:09:04.543434 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:04.543475 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260811 11:09:04.616693 25125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:04.616444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:43865)
0811 11:09:04.616601 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:04.616644 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":67,"threads_started":1}
I20260811 11:09:04.745663 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:04.745437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:35723)
0811 11:09:04.745583 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:04.745620 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":63,"threads_started":1}
I20260811 11:09:05.544245 25129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:05.544014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:56119)
0811 11:09:05.544156 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:05.544195 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260811 11:09:05.617419 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:05.617222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:58051)
0811 11:09:05.617345 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:05.617380 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260811 11:09:05.746388 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:05.746121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:56761)
0811 11:09:05.746311 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:05.746345 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":116,"threads_started":1}
I20260811 11:09:05.905876 25137 raft_consensus.cc:482] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:05.905983 25137 raft_consensus.cc:504] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:09:05.906351 25137 leader_election.cc:288] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811), cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
W20260811 11:09:05.906816 24452 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
W20260811 11:09:05.906904 24447 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
I20260811 11:09:05.906994 24447 leader_election.cc:302] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5ba66f8d464a5c9e8aa2cddf469b46; no voters: cb933d9a2e6e4ace9dfcf2c110fc8fa9, fd59f2173c0e41e4877d858492766b4a
I20260811 11:09:05.907065 25137 raft_consensus.cc:2726] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:09:06.545161 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:06.544919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:44973)
0811 11:09:06.545060 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:06.545110 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":63,"threads_started":1}
I20260811 11:09:06.618148 25140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:06.617915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:38309)
0811 11:09:06.618060 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:06.618105 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":65,"threads_started":1}
I20260811 11:09:06.747112 25141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:06.746883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:44319)
0811 11:09:06.747018 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:06.747066 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260811 11:09:07.546110 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:07.545840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:56947)
0811 11:09:07.545992 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:07.546034 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":69,"threads_started":1}
I20260811 11:09:07.618875 25144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:07.618629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:58037)
0811 11:09:07.618793 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:07.618831 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":64,"threads_started":1}
I20260811 11:09:07.747844 25145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:07.747634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:58915)
0811 11:09:07.747758 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:07.747797 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260811 11:09:08.546926 25150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:08.546664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:39561)
0811 11:09:08.546819 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:08.546859 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260811 11:09:08.619549 25151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:08.619334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:48409)
0811 11:09:08.619470 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:08.619507 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":60,"threads_started":1}
I20260811 11:09:08.666080 25152 raft_consensus.cc:482] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:08.666246 25152 raft_consensus.cc:504] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:09:08.666442 25152 leader_election.cc:288] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811), cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
W20260811 11:09:08.666841 24447 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
W20260811 11:09:08.666934 24452 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
I20260811 11:09:08.666999 24452 leader_election.cc:302] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5ba66f8d464a5c9e8aa2cddf469b46; no voters: cb933d9a2e6e4ace9dfcf2c110fc8fa9, fd59f2173c0e41e4877d858492766b4a
I20260811 11:09:08.667078 25152 raft_consensus.cc:2726] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:09:08.748536 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:08.748306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:38829)
0811 11:09:08.748453 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:08.748492 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260811 11:09:09.547588 25155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:09.547350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:36539)
0811 11:09:09.547483 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:09.547518 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260811 11:09:09.620196 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:09.619989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:52359)
0811 11:09:09.620115 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:09.620152 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260811 11:09:09.749269 25158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:09.749023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:48359)
0811 11:09:09.749156 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:09.749221 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 11:09:10.548307 25160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:10.548052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:60069)
0811 11:09:10.548196 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:10.548241 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260811 11:09:10.620922 25164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:10.620720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:38951)
0811 11:09:10.620846 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:10.620881 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260811 11:09:10.749972 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:10.749760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:52943)
0811 11:09:10.749887 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:10.749926 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260811 11:09:11.549073 25167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:11.548854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:34779)
0811 11:09:11.548985 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:11.549023 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 11:09:11.621665 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:11.621438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:52941)
0811 11:09:11.621586 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:11.621622 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260811 11:09:11.686780 25172 raft_consensus.cc:482] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:11.686882 25172 raft_consensus.cc:504] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd59f2173c0e41e4877d858492766b4a" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 43811 } } peers { permanent_uuid: "cb933d9a2e6e4ace9dfcf2c110fc8fa9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33301 } } peers { permanent_uuid: "9a5ba66f8d464a5c9e8aa2cddf469b46" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36169 } }
I20260811 11:09:11.687050 25172 leader_election.cc:288] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811), cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301)
W20260811 11:09:11.687439 24447 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fd59f2173c0e41e4877d858492766b4a (127.25.227.2:43811): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
W20260811 11:09:11.687511 24452 leader_election.cc:341] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cb933d9a2e6e4ace9dfcf2c110fc8fa9 (127.25.227.3:33301): Not found: Tablet not found: 956849f7d8644c7696244010c7e21c50
I20260811 11:09:11.687590 24452 leader_election.cc:302] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5ba66f8d464a5c9e8aa2cddf469b46; no voters: cb933d9a2e6e4ace9dfcf2c110fc8fa9, fd59f2173c0e41e4877d858492766b4a
I20260811 11:09:11.687666 25172 raft_consensus.cc:2726] T 956849f7d8644c7696244010c7e21c50 P 9a5ba66f8d464a5c9e8aa2cddf469b46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 11:09:11.750658 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:11.750431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:60889)
0811 11:09:11.750573 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:11.750611 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260811 11:09:12.549814 25174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:12.549566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:54183)
0811 11:09:12.549701 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:12.549743 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 11:09:12.622386 25177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:12.622181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:47399)
0811 11:09:12.622306 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:12.622342 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260811 11:09:12.751329 25179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:12.751118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:36579)
0811 11:09:12.751249 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:12.751286 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260811 11:09:13.550536 25181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:13.550329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:55321)
0811 11:09:13.550453 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:13.550486 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260811 11:09:13.623129 25182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:13.622914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:60223)
0811 11:09:13.623046 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:13.623084 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260811 11:09:13.751998 25184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:13.751796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:51557)
0811 11:09:13.751918 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:13.751952 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260811 11:09:14.551311 25185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:14.551068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:59065)
0811 11:09:14.551215 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:14.551258 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260811 11:09:14.623948 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:14.623660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:53277)
0811 11:09:14.623859 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:14.623899 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":63,"threads_started":1}
I20260811 11:09:14.752731 25189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:14.752489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:51299)
0811 11:09:14.752631 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:14.752681 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260811 11:09:15.552037 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:15.551804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:55537)
0811 11:09:15.551944 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:15.551988 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":67,"threads_started":1}
I20260811 11:09:15.624607 25192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:15.624399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:37897)
0811 11:09:15.624521 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:15.624559 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260811 11:09:15.753481 25193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:15.753235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:49219)
0811 11:09:15.753401 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:15.753437 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":61,"threads_started":1}
I20260811 11:09:16.552768 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:16.552510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:55537)
0811 11:09:16.552645 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:16.552692 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":53,"threads_started":1}
I20260811 11:09:16.625275 25197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:16.625003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:49915)
0811 11:09:16.625135 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:16.625221 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260811 11:09:16.754225 25199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:16.753972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:51703)
0811 11:09:16.754125 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:16.754166 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260811 11:09:17.553579 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:17.553372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.1:58573)
0811 11:09:17.553492 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:17.553528 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260811 11:09:17.625932 25202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:17.625704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.2:49655)
0811 11:09:17.625850 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:17.625887 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260811 11:09:17.750015 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 24357
I20260811 11:09:17.758723 25207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:17.756467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46289 (local address 127.25.227.3:34741)
0811 11:09:17.758610 (+ 2143us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:17.758659 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.62:46289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2122,"thread_start_us":896,"threads_started":1}
I20260811 11:09:17.766930 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 24646
I20260811 11:09:17.781600 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 24869
2026-08-11T11:09:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58835 ms)
[----------] 30 tests from SecurityITest (242263 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:17 dist-test-slave-z8x9 krb5kdc[25211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:17 dist-test-slave-z8x9 krb5kdc[25211](info): set up 2 sockets
Aug 11 11:09:17 dist-test-slave-z8x9 krb5kdc[25211](info): commencing operation
krb5kdc: starting...
W20260811 11:09:19.086156 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:19.209069 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41699
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:19.291482 25233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:19.291740 25233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:19.291780 25233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:19.292956 25233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:19.293021 25233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:19.293043 25233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:19.293063 25233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:19.293097 25233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:19.294606 25233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:19.294881 25233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:19.295116 25233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:19.300606 25246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.300622 25240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.300627 25242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:19.300657 25233 server_base.cc:1034] running on GCE node
I20260811 11:09:19.301206 25233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:19.301512 25233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:19.302673 25233 hybrid_clock.cc:648] HybridClock initialized: now 1786446559302665 us; error 37 us; skew 500 ppm
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:19.305263 25233 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:19.305720 25233 webserver.cc:460] Webserver started at http://127.25.227.62:40241/ using document root <none> and password file <none>
I20260811 11:09:19.305944 25233 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:19.306013 25233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:19.306166 25233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:19.307255 25233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "b4f74b4953eb4eaaa62324a103888ccb"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "073437d57cd8dddd49ea4ef07d5cc0f3"
server_key_iv: "502eab48772007c707f847d4002142de"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.307629 25233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "b4f74b4953eb4eaaa62324a103888ccb"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "073437d57cd8dddd49ea4ef07d5cc0f3"
server_key_iv: "502eab48772007c707f847d4002142de"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.309080 25233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:19.309891 25258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.310060 25233 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:19.310160 25233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "b4f74b4953eb4eaaa62324a103888ccb"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "073437d57cd8dddd49ea4ef07d5cc0f3"
server_key_iv: "502eab48772007c707f847d4002142de"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.310241 25233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:19.318393 25233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:19.320650 25233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:19.320811 25233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:19.324922 25233 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:41699
I20260811 11:09:19.324956 25348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:41699 every 8 connection(s)
I20260811 11:09:19.325368 25233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:19.326234 25350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:19.328536 25350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb: Bootstrap starting.
I20260811 11:09:19.329273 25350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:19.329573 25350 log.cc:824] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:19.330355 25350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb: No bootstrap required, opened a new log
I20260811 11:09:19.331955 25350 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f74b4953eb4eaaa62324a103888ccb" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41699 } }
I20260811 11:09:19.332095 25350 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:19.332118 25350 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f74b4953eb4eaaa62324a103888ccb, State: Initialized, Role: FOLLOWER
I20260811 11:09:19.332291 25350 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f74b4953eb4eaaa62324a103888ccb" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41699 } }
I20260811 11:09:19.332362 25350 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:19.332396 25350 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:19.332442 25350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:19.332983 25350 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f74b4953eb4eaaa62324a103888ccb" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41699 } }
I20260811 11:09:19.333097 25350 leader_election.cc:302] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4f74b4953eb4eaaa62324a103888ccb; no voters:
I20260811 11:09:19.333313 25350 leader_election.cc:288] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:19.333350 25356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:19.333499 25356 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [term 1 LEADER]: Becoming Leader. State: Replica: b4f74b4953eb4eaaa62324a103888ccb, State: Running, Role: LEADER
I20260811 11:09:19.333580 25350 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:19.333638 25356 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f74b4953eb4eaaa62324a103888ccb" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41699 } }
I20260811 11:09:19.333842 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 25233
I20260811 11:09:19.333949 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:19.334010 25358 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4f74b4953eb4eaaa62324a103888ccb. Latest consensus state: current_term: 1 leader_uuid: "b4f74b4953eb4eaaa62324a103888ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f74b4953eb4eaaa62324a103888ccb" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41699 } } }
I20260811 11:09:19.334088 25358 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:19.334148 25357 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4f74b4953eb4eaaa62324a103888ccb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f74b4953eb4eaaa62324a103888ccb" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41699 } } }
I20260811 11:09:19.334179 26508 external_mini_cluster.cc:1428] Setting key 2d1e1dff56f2f7f763c064da5776ead9
I20260811 11:09:19.334210 25357 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:19.334342 25366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:19.334888 25366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:19.336587 25366 catalog_manager.cc:1347] Generated new cluster ID: 5d9097bb629c4b7fb9bd3fb431631223
I20260811 11:09:19.336648 25366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:19.346343 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.334859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37474 (local address 127.25.227.62:41699)
0811 11:09:19.335333 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.335342 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.335374 (+ 32us) server_negotiation.cc:407] Connection header received
0811 11:09:19.335487 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.335494 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.335551 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.335707 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:19.336508 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.337924 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.338970 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.339621 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.339738 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.342665 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:19.342669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:19.342669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:19.342682 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:19.344657 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.345085 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.345088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.345089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.345212 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.345420 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.345420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.345421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.345714 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:19.345854 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.345981 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.346110 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":68,"threads_started":1}
I20260811 11:09:19.353861 25366 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:19.354601 25366 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:19.361734 25366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb: Generated new TSK 0
I20260811 11:09:19.361963 25366 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:09:19.390074 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41699
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:19.473632 25398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:19.473839 25398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:19.473863 25398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:19.474978 25398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:19.475021 25398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:19.475069 25398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:19.476490 25398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:19.476722 25398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:19.476940 25398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:19.481922 25414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:19.482050 25398 server_base.cc:1034] running on GCE node
W20260811 11:09:19.481935 25405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.481971 25411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:19.482412 25398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:19.482645 25398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:19.483794 25398 hybrid_clock.cc:648] HybridClock initialized: now 1786446559483780 us; error 30 us; skew 500 ppm
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:19.486546 25398 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:09:19.486963 25398 webserver.cc:460] Webserver started at http://127.25.227.1:42233/ using document root <none> and password file <none>
I20260811 11:09:19.487180 25398 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:19.487244 25398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:19.487398 25398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:19.488409 25398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "54c48ba2c9726ea55f371d97c6f69fb5"
server_key_iv: "96980f8e4a8c6f842c538638a5732329"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.488777 25398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "54c48ba2c9726ea55f371d97c6f69fb5"
server_key_iv: "96980f8e4a8c6f842c538638a5732329"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.490142 25398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:19.490867 25427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.491030 25398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:19.491132 25398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "54c48ba2c9726ea55f371d97c6f69fb5"
server_key_iv: "96980f8e4a8c6f842c538638a5732329"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.491204 25398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:19.500123 25398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:19.502414 25398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:19.502565 25398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:19.502784 25398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:19.503079 25398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:19.503136 25398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.503177 25398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:19.503206 25398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.509104 25398 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:33739
I20260811 11:09:19.509152 25625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:33739 every 8 connection(s)
I20260811 11:09:19.509529 25398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:19.515944 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 25398
I20260811 11:09:19.516062 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:09:19.516292 26508 external_mini_cluster.cc:1428] Setting key 7eeea188e358448f751d37bdecdcb59f
I20260811 11:09:19.518783 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.510193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:36597 (local address 127.25.227.62:41699)
0811 11:09:19.510241 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.510244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.510499 (+ 255us) server_negotiation.cc:407] Connection header received
0811 11:09:19.510963 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.510964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.510979 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.511022 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:19.511907 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.512419 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.513525 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.513717 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.513777 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.515810 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:19.515811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:19.515812 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:19.515820 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:19.517411 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.517800 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.517801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.517802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.517861 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.518117 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.518118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.518118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.518232 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:19.518300 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.518578 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.518673 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:09:19.518929 25629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.510186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41699 (local address 127.25.227.1:36597)
0811 11:09:19.510385 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.510420 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.510872 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.511084 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.511087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.511638 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:19.511833 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.511837 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.512496 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.512497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.513443 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.513450 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.513791 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.513792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.513910 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.514354 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:19.514362 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:19.515712 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:19.517490 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:19.517498 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:19.517501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:19.517723 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:19.517939 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:19.517939 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:19.517940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:19.518046 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:19.518303 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:19.518310 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:19.518443 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.518541 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.518696 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":116,"threads_started":1}
I20260811 11:09:19.519456 25626 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41699
I20260811 11:09:19.519547 25626 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:19.519738 25626 heartbeater.cc:511] Master 127.25.227.62:41699 requested a full tablet report, sending...
I20260811 11:09:19.520282 25286 ts_manager.cc:194] Registered new tserver with Master: 6a1a7d5bffdb46c3ad3f7a668f85fa39 (127.25.227.1:33739)
I20260811 11:09:19.521198 25286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:36597
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:09:19.543457 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41699
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:19.626631 25637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:19.626876 25637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:19.626914 25637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:19.628026 25637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:19.628090 25637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:19.628134 25637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:19.629594 25637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:19.629873 25637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:19.630125 25637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:19.635377 25652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.635358 25643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.635385 25645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:19.635421 25637 server_base.cc:1034] running on GCE node
I20260811 11:09:19.635751 25637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:19.635977 25637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:19.637135 25637 hybrid_clock.cc:648] HybridClock initialized: now 1786446559637112 us; error 40 us; skew 500 ppm
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:19.639668 25637 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:09:19.640050 25637 webserver.cc:460] Webserver started at http://127.25.227.2:43753/ using document root <none> and password file <none>
I20260811 11:09:19.640264 25637 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:19.640306 25637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:19.640393 25637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:19.641434 25637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "ff55566df3f44094a7839a3c7ef1fa98"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "1f725d7dd77a25b0b6e94245c041b2d7"
server_key_iv: "c18baedf489da133b92182a240581778"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.641737 25637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "ff55566df3f44094a7839a3c7ef1fa98"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "1f725d7dd77a25b0b6e94245c041b2d7"
server_key_iv: "c18baedf489da133b92182a240581778"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.643010 25637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:19.643712 25672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.643916 25637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:19.644003 25637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "ff55566df3f44094a7839a3c7ef1fa98"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "1f725d7dd77a25b0b6e94245c041b2d7"
server_key_iv: "c18baedf489da133b92182a240581778"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.644057 25637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:19.664770 25637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:19.666870 25637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:19.666988 25637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:19.667160 25637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:19.667496 25637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:19.667533 25637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.667575 25637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:19.667603 25637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.673372 25637 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:37903
I20260811 11:09:19.673449 25846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:37903 every 8 connection(s)
I20260811 11:09:19.673758 25637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:09:19.679060 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 25637
I20260811 11:09:19.679203 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:09:19.679414 26508 external_mini_cluster.cc:1428] Setting key 35587757fd500f9a9cc3686fea6b98fd
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:19.683470 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.674493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:40911 (local address 127.25.227.62:41699)
0811 11:09:19.674541 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.674547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.674737 (+ 190us) server_negotiation.cc:407] Connection header received
0811 11:09:19.675213 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.675214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.675223 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.675291 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:19.676177 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.676672 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.677703 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.677896 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.677952 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.680327 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:19.680330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:19.680330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:19.680339 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:19.682003 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.682526 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.682527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.682528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.682582 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.682869 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.682869 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.682869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.682969 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:19.683019 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.683337 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.683406 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:09:19.683797 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.674452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41699 (local address 127.25.227.2:40911)
0811 11:09:19.674620 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.674662 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.675132 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.675343 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.675346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.675907 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:19.676099 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.676104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.676750 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.676751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.677631 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.677634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.677968 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.677968 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.678070 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.678597 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:19.678605 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:19.680238 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:19.682099 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:19.682108 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:19.682111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:19.682450 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:19.682647 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:19.682648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:19.682648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:19.682805 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:19.683027 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:19.683034 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:19.683198 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.683318 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.683502 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260811 11:09:19.684320 25848 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41699
I20260811 11:09:19.684412 25848 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:19.684598 25848 heartbeater.cc:511] Master 127.25.227.62:41699 requested a full tablet report, sending...
I20260811 11:09:19.685000 25286 ts_manager.cc:194] Registered new tserver with Master: ff55566df3f44094a7839a3c7ef1fa98 (127.25.227.2:37903)
I20260811 11:09:19.685480 25286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:40911
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:09:19.705956 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41699
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:35757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:19.791934 25855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:19.792187 25855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:19.792239 25855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:19.793459 25855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:19.793522 25855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:19.793566 25855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:19.795127 25855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:35757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:41699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:19.795393 25855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:19.795624 25855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:19.800894 25862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.800949 25868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:19.801003 25863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:19.801224 25855 server_base.cc:1034] running on GCE node
I20260811 11:09:19.801488 25855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:19.801754 25855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:19.802919 25855 hybrid_clock.cc:648] HybridClock initialized: now 1786446559802893 us; error 41 us; skew 500 ppm
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:19.805565 25855 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:09:19.805998 25855 webserver.cc:460] Webserver started at http://127.25.227.3:42033/ using document root <none> and password file <none>
I20260811 11:09:19.806219 25855 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:19.806273 25855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:19.806394 25855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:19.807449 25855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "3225d389c98741368a1939695525b38e"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "2cbd71646000f6f1787a8b11eb8e70fb"
server_key_iv: "602657b6eacbd1269d2ffc2428ff0d3f"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.807812 25855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "3225d389c98741368a1939695525b38e"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "2cbd71646000f6f1787a8b11eb8e70fb"
server_key_iv: "602657b6eacbd1269d2ffc2428ff0d3f"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.809273 25855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 11:09:19.810045 25884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.810221 25855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:19.810315 25855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "3225d389c98741368a1939695525b38e"
format_stamp: "Formatted at 2026-08-11 11:09:19 on dist-test-slave-z8x9"
server_key: "2cbd71646000f6f1787a8b11eb8e70fb"
server_key_iv: "602657b6eacbd1269d2ffc2428ff0d3f"
server_key_version: "encryptionkey@0"
I20260811 11:09:19.810369 25855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:19.848269 25855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:19.850306 25855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:19.850422 25855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:19.850625 25855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:19.850889 25855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:19.850921 25855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.850945 25855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:19.850958 25855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:19.856737 25855 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:45197
I20260811 11:09:19.856822 26077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:45197 every 8 connection(s)
I20260811 11:09:19.857187 25855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:09:19.861635 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 25855
I20260811 11:09:19.861775 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:09:19.862006 26508 external_mini_cluster.cc:1428] Setting key 06975b4e4a2adcdb5250a13bc1a45ad1
Aug 11 11:09:19 dist-test-slave-z8x9 krb5kdc[25211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446559, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:19.866189 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.857907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:42129 (local address 127.25.227.62:41699)
0811 11:09:19.857977 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.857979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.858211 (+ 232us) server_negotiation.cc:407] Connection header received
0811 11:09:19.858696 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.858697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.858708 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.858756 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:19.859688 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.860178 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.861156 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.861404 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.861474 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.863828 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:19.863830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:19.863830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:19.863837 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:19.865002 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.865432 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.865433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.865433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.865496 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.865704 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.865704 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.865704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.865810 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:19.865858 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.866066 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.866128 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 11:09:19.866434 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.857893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41699 (local address 127.25.227.3:42129)
0811 11:09:19.858089 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.858125 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.858595 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.858816 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.858820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.859402 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:19.859591 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.859596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.860281 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.860282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.861078 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.861080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.861500 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.861502 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.861676 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.862285 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:19.862296 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:19.863724 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:19.865068 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:19.865074 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:19.865076 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:19.865341 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:19.865562 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:19.865562 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:19.865563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:19.865663 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:19.865858 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:19.865863 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:19.865973 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.866054 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.866172 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":112,"threads_started":1}
I20260811 11:09:19.866864 26079 heartbeater.cc:347] Connected to a master server at 127.25.227.62:41699
I20260811 11:09:19.866945 26079 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:19.867085 26079 heartbeater.cc:511] Master 127.25.227.62:41699 requested a full tablet report, sending...
I20260811 11:09:19.867420 25286 ts_manager.cc:194] Registered new tserver with Master: 3225d389c98741368a1939695525b38e (127.25.227.3:45197)
I20260811 11:09:19.867792 25286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:42129
I20260811 11:09:19.873620 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:09:19.880203 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.874874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37486 (local address 127.25.227.62:41699)
0811 11:09:19.874928 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.874930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.875051 (+ 121us) server_negotiation.cc:407] Connection header received
0811 11:09:19.875089 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.875089 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.875097 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.875140 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:19.875641 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.876102 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.876762 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.876930 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.876977 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.878079 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:19.878080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:19.878081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:19.878087 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:19.879267 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.879565 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.879566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.879566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.879614 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:19.879773 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:19.879774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:19.879774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:19.879901 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:19.879973 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.880067 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.880125 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:09:19.881597 25286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:09:19.883147 25286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:09:19.889525 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.885735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:33739 (local address 127.0.0.1:57548)
0811 11:09:19.885883 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.885894 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.885946 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.886267 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.886268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.886270 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:19.886315 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.886316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.887158 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.887159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.888380 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.888383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.889280 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.889281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.889342 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.889347 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.889390 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.889458 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":21,"thread_start_us":77,"threads_started":1}
I20260811 11:09:19.889525 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.885465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56668 (local address 127.25.227.3:45197)
0811 11:09:19.885762 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.885767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.885921 (+ 154us) server_negotiation.cc:407] Connection header received
0811 11:09:19.885966 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.885968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.885982 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.886049 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:19.886283 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.887399 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.888513 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.889093 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.889177 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.889265 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.889400 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.889447 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":90,"threads_started":1}
I20260811 11:09:19.889689 26109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.885898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57548 (local address 127.25.227.1:33739)
0811 11:09:19.886087 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.886091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.886101 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:19.886144 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.886146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.886162 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.886271 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:19.886380 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.887060 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.888473 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.889144 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.889441 (+ 297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.889514 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.889540 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.889585 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":80,"threads_started":1}
I20260811 11:09:19.890033 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.885458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:37903 (local address 127.0.0.1:39102)
0811 11:09:19.885606 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.885651 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.885723 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.886113 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.886116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.886118 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:19.886188 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.886190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.887622 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.887623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.888709 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.888712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.889779 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.889780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.889847 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.889850 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.889927 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.889966 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":6,"thread_start_us":88,"threads_started":1}
I20260811 11:09:19.890066 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.885478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39102 (local address 127.25.227.2:37903)
0811 11:09:19.885680 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.885685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.885701 (+ 16us) server_negotiation.cc:407] Connection header received
0811 11:09:19.885885 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.885889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.885907 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.885978 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:19.886461 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.887508 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.888799 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.889570 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.889683 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.889741 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.889948 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.889990 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":83,"threads_started":1}
I20260811 11:09:19.890447 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.885604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:45197 (local address 127.0.0.1:56668)
0811 11:09:19.885807 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.885817 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.885869 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.886118 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.886118 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.886120 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:19.886188 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.886190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.887512 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.887513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.888420 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.888422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.889197 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.889198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.889280 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.889294 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.889385 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.890030 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":72,"threads_started":1}
I20260811 11:09:19.890398 25514 tablet_service.cc:1467] Processing CreateTablet for tablet b08110bdfedf446789a2907361e693eb (DEFAULT_TABLE table=test-table [id=1ce69c951e564053aeb5973d4828a2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:19.890801 25514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b08110bdfedf446789a2907361e693eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:19.891144 25969 tablet_service.cc:1467] Processing CreateTablet for tablet b08110bdfedf446789a2907361e693eb (DEFAULT_TABLE table=test-table [id=1ce69c951e564053aeb5973d4828a2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:19.891455 25969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b08110bdfedf446789a2907361e693eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:19.893642 25745 tablet_service.cc:1467] Processing CreateTablet for tablet b08110bdfedf446789a2907361e693eb (DEFAULT_TABLE table=test-table [id=1ce69c951e564053aeb5973d4828a2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:19.893934 25745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b08110bdfedf446789a2907361e693eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:19.894119 26110 tablet_bootstrap.cc:492] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Bootstrap starting.
I20260811 11:09:19.894717 26110 tablet_bootstrap.cc:654] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:19.895227 26110 log.cc:824] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:19.895936 26110 tablet_bootstrap.cc:492] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: No bootstrap required, opened a new log
I20260811 11:09:19.895991 26110 ts_tablet_manager.cc:1397] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:19.896585 26113 tablet_bootstrap.cc:492] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Bootstrap starting.
I20260811 11:09:19.897323 26114 tablet_bootstrap.cc:492] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39: Bootstrap starting.
I20260811 11:09:19.897480 26113 tablet_bootstrap.cc:654] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:19.897974 26110 raft_consensus.cc:348] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.898066 26114 tablet_bootstrap.cc:654] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:19.898129 26110 raft_consensus.cc:374] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:19.898141 26113 log.cc:824] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:19.898175 26110 raft_consensus.cc:729] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3225d389c98741368a1939695525b38e, State: Initialized, Role: FOLLOWER
I20260811 11:09:19.898301 26110 consensus_queue.cc:260] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.898609 26110 ts_tablet_manager.cc:1428] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:09:19.898648 26114 log.cc:824] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:19.898761 26079 heartbeater.cc:503] Master 127.25.227.62:41699 was elected leader, sending a full tablet report...
I20260811 11:09:19.899092 26113 tablet_bootstrap.cc:492] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: No bootstrap required, opened a new log
I20260811 11:09:19.899168 26113 ts_tablet_manager.cc:1397] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 11:09:19.899403 26114 tablet_bootstrap.cc:492] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39: No bootstrap required, opened a new log
I20260811 11:09:19.899480 26114 ts_tablet_manager.cc:1397] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:09:19.901199 26113 raft_consensus.cc:348] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.901379 26113 raft_consensus.cc:374] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:19.901427 26113 raft_consensus.cc:729] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff55566df3f44094a7839a3c7ef1fa98, State: Initialized, Role: FOLLOWER
I20260811 11:09:19.901543 26113 consensus_queue.cc:260] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.901479 26114 raft_consensus.cc:348] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.901628 26114 raft_consensus.cc:374] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:19.901684 26114 raft_consensus.cc:729] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a1a7d5bffdb46c3ad3f7a668f85fa39, State: Initialized, Role: FOLLOWER
I20260811 11:09:19.901829 25848 heartbeater.cc:503] Master 127.25.227.62:41699 was elected leader, sending a full tablet report...
I20260811 11:09:19.901806 26114 consensus_queue.cc:260] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.901844 26113 ts_tablet_manager.cc:1428] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:09:19.902094 26114 ts_tablet_manager.cc:1428] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:09:19.902105 25626 heartbeater.cc:503] Master 127.25.227.62:41699 was elected leader, sending a full tablet report...
I20260811 11:09:19.903793 26121 raft_consensus.cc:482] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:19.903860 26121 raft_consensus.cc:504] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.904112 26121 leader_election.cc:288] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3225d389c98741368a1939695525b38e (127.25.227.3:45197), 6a1a7d5bffdb46c3ad3f7a668f85fa39 (127.25.227.1:33739)
I20260811 11:09:19.907742 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.904302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:57483 (local address 127.25.227.3:45197)
0811 11:09:19.904343 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.904345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.904354 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:09:19.904402 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.904402 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.904412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.904471 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:19.904595 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.905364 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.906842 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.907410 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.907478 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.907486 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.907637 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.907688 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:09:19.907735 26109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.904296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:51689 (local address 127.25.227.1:33739)
0811 11:09:19.904386 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.904388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.904429 (+ 41us) server_negotiation.cc:407] Connection header received
0811 11:09:19.904483 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.904484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.904493 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.904540 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:19.904666 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.905364 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.906842 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.907402 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.907478 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.907486 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.907637 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.907674 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 11:09:19.907797 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.904236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:45197 (local address 127.25.227.2:57483)
0811 11:09:19.904289 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.904299 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.904340 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.904471 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.904472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.904473 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:19.904533 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.904535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.905439 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.905440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.906760 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.906762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.907483 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.907484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.907564 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.907566 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.907623 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.907677 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":68}
I20260811 11:09:19.908131 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08110bdfedf446789a2907361e693eb" candidate_uuid: "ff55566df3f44094a7839a3c7ef1fa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3225d389c98741368a1939695525b38e" is_pre_election: true
I20260811 11:09:19.908170 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.904247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:33739 (local address 127.25.227.2:51689)
0811 11:09:19.904379 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.904389 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:19.904438 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:19.904543 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:19.904544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:19.904545 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:19.904606 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.904608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.905439 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.905440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.906745 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:19.906748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.907483 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.907484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:19.907561 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.907565 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:19.907623 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 11:09:19.907677 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":87,"thread_start_us":85,"threads_started":1}
I20260811 11:09:19.908234 25999 raft_consensus.cc:2454] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff55566df3f44094a7839a3c7ef1fa98 in term 0.
I20260811 11:09:19.908479 25674 leader_election.cc:302] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3225d389c98741368a1939695525b38e, ff55566df3f44094a7839a3c7ef1fa98; no voters:
I20260811 11:09:19.908468 25553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08110bdfedf446789a2907361e693eb" candidate_uuid: "ff55566df3f44094a7839a3c7ef1fa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" is_pre_election: true
I20260811 11:09:19.908587 25553 raft_consensus.cc:2454] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff55566df3f44094a7839a3c7ef1fa98 in term 0.
I20260811 11:09:19.908593 26121 raft_consensus.cc:2781] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:09:19.908643 26121 raft_consensus.cc:482] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:09:19.908684 26121 raft_consensus.cc:3037] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:19.909410 26121 raft_consensus.cc:504] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.909547 26121 leader_election.cc:288] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [CANDIDATE]: Term 1 election: Requested vote from peers 3225d389c98741368a1939695525b38e (127.25.227.3:45197), 6a1a7d5bffdb46c3ad3f7a668f85fa39 (127.25.227.1:33739)
I20260811 11:09:19.909678 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08110bdfedf446789a2907361e693eb" candidate_uuid: "ff55566df3f44094a7839a3c7ef1fa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3225d389c98741368a1939695525b38e"
I20260811 11:09:19.909752 25999 raft_consensus.cc:3037] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:19.909735 25553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b08110bdfedf446789a2907361e693eb" candidate_uuid: "ff55566df3f44094a7839a3c7ef1fa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39"
I20260811 11:09:19.909814 25553 raft_consensus.cc:3037] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:19.910478 25553 raft_consensus.cc:2454] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff55566df3f44094a7839a3c7ef1fa98 in term 1.
I20260811 11:09:19.910486 25999 raft_consensus.cc:2454] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff55566df3f44094a7839a3c7ef1fa98 in term 1.
I20260811 11:09:19.910653 25675 leader_election.cc:302] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a1a7d5bffdb46c3ad3f7a668f85fa39, ff55566df3f44094a7839a3c7ef1fa98; no voters:
I20260811 11:09:19.910794 26121 raft_consensus.cc:2781] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:19.910966 26121 raft_consensus.cc:686] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 1 LEADER]: Becoming Leader. State: Replica: ff55566df3f44094a7839a3c7ef1fa98, State: Running, Role: LEADER
I20260811 11:09:19.911072 26121 consensus_queue.cc:237] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } }
I20260811 11:09:19.911823 25286 catalog_manager.cc:5495] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff55566df3f44094a7839a3c7ef1fa98 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "ff55566df3f44094a7839a3c7ef1fa98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff55566df3f44094a7839a3c7ef1fa98" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 } health_report { overall_health: UNKNOWN } } }
I20260811 11:09:19.916500 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.914467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39106 (local address 127.25.227.2:37903)
0811 11:09:19.914520 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:19.914526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:19.914534 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:09:19.914595 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:19.914595 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:19.914610 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:19.914670 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:19.914772 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.915191 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.915865 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:19.916037 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:19.916086 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:19.916201 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:19.916292 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:19.916344 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:19.916376 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 11:09:19.916392 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 11:09:19.918103 25553 raft_consensus.cc:1261] T b08110bdfedf446789a2907361e693eb P 6a1a7d5bffdb46c3ad3f7a668f85fa39 [term 1 FOLLOWER]: Refusing update from remote peer ff55566df3f44094a7839a3c7ef1fa98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:19.918135 25999 raft_consensus.cc:1261] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 1 FOLLOWER]: Refusing update from remote peer ff55566df3f44094a7839a3c7ef1fa98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:19.918448 26128 consensus_queue.cc:1035] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a1a7d5bffdb46c3ad3f7a668f85fa39" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:19.918566 26121 consensus_queue.cc:1035] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3225d389c98741368a1939695525b38e" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 45197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:19.923051 25285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:19.923152 25285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:19.923867 25285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4f74b4953eb4eaaa62324a103888ccb: Sending DeleteTablet for 3 replicas of tablet b08110bdfedf446789a2907361e693eb
I20260811 11:09:19.924171 25745 tablet_service.cc:1514] Processing DeleteTablet for tablet b08110bdfedf446789a2907361e693eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:19 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:39102
I20260811 11:09:19.924230 25969 tablet_service.cc:1514] Processing DeleteTablet for tablet b08110bdfedf446789a2907361e693eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:19 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:56668
I20260811 11:09:19.924239 25514 tablet_service.cc:1514] Processing DeleteTablet for tablet b08110bdfedf446789a2907361e693eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:19 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:57548
I20260811 11:09:19.924444 26156 tablet_replica.cc:330] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: stopping tablet replica
I20260811 11:09:19.924539 26156 raft_consensus.cc:2229] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:19.924638 26156 raft_consensus.cc:2258] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:19.924713 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 25398
I20260811 11:09:19.937115 26156 ts_tablet_manager.cc:1905] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:19.939720 26156 ts_tablet_manager.cc:1918] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:19.939802 26156 log.cc:1196] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/b08110bdfedf446789a2907361e693eb
I20260811 11:09:19.940040 26156 ts_tablet_manager.cc:1939] T b08110bdfedf446789a2907361e693eb P 3225d389c98741368a1939695525b38e: Deleting consensus metadata
I20260811 11:09:19.940455 25259 catalog_manager.cc:4841] TS 3225d389c98741368a1939695525b38e (127.25.227.3:45197): tablet b08110bdfedf446789a2907361e693eb (table test-table [id=1ce69c951e564053aeb5973d4828a2eb]) successfully deleted
I20260811 11:09:19.957154 26155 tablet_replica.cc:330] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: stopping tablet replica
I20260811 11:09:19.957367 26155 raft_consensus.cc:2229] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:09:19.957497 26155 raft_consensus.cc:2258] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:19.957963 26155 ts_tablet_manager.cc:1905] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:19.959409 26155 ts_tablet_manager.cc:1918] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:19.959506 26155 log.cc:1196] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/b08110bdfedf446789a2907361e693eb
I20260811 11:09:19.959769 26155 ts_tablet_manager.cc:1939] T b08110bdfedf446789a2907361e693eb P ff55566df3f44094a7839a3c7ef1fa98: Deleting consensus metadata
I20260811 11:09:19.960237 25260 catalog_manager.cc:4841] TS ff55566df3f44094a7839a3c7ef1fa98 (127.25.227.2:37903): tablet b08110bdfedf446789a2907361e693eb (table test-table [id=1ce69c951e564053aeb5973d4828a2eb]) successfully deleted
W20260811 11:09:19.962996 25260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:33739 (error 108)
I20260811 11:09:19.963567 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:19.963430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:33739 (local address 127.0.0.1:57560)
0811 11:09:19.963487 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:19.963531 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:33739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 11:09:19.963694 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 25637
W20260811 11:09:19.983978 25260 catalog_manager.cc:4584] TS 6a1a7d5bffdb46c3ad3f7a668f85fa39 (127.25.227.1:33739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b08110bdfedf446789a2907361e693eb: Network error: Client connection negotiation failed: client connection to 127.25.227.1:33739: connect: Connection refused (error 111)
I20260811 11:09:19.988912 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 25855
I20260811 11:09:20.003459 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 25233
2026-08-11T11:09:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2222 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T11:09:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:20Z Disabled control of system clock
I20260811 11:09:20.039529 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45829
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:45163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:45829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:20.123368 26170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:20.123656 26170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:20.123677 26170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:20.124812 26170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:20.124856 26170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:20.124871 26170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:20.124917 26170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:20.124941 26170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:20.126338 26170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:45829
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:20.126586 26170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:20.126940 26170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:20.131858 26178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.131891 26189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:20.131891 26170 server_base.cc:1034] running on GCE node
W20260811 11:09:20.131872 26186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:20.132387 26170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:20.132707 26170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:20.133867 26170 hybrid_clock.cc:648] HybridClock initialized: now 1786446560133844 us; error 42 us; skew 500 ppm
I20260811 11:09:20.135056 26170 webserver.cc:460] Webserver started at http://127.25.227.62:37981/ using document root <none> and password file <none>
I20260811 11:09:20.135291 26170 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:20.135360 26170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:20.135514 26170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:20.136559 26170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "affcadc329134ec5b1a44a625d46644b"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "dcd77bf6c4e6d774d98399d3c41c81e6"
server_key_iv: "115044b9cd647b140f0305c7a3ef984c"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.136925 26170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "affcadc329134ec5b1a44a625d46644b"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "dcd77bf6c4e6d774d98399d3c41c81e6"
server_key_iv: "115044b9cd647b140f0305c7a3ef984c"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.138317 26170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:20.139039 26202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.139221 26170 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:20.139323 26170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "affcadc329134ec5b1a44a625d46644b"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "dcd77bf6c4e6d774d98399d3c41c81e6"
server_key_iv: "115044b9cd647b140f0305c7a3ef984c"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.139406 26170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:20.149091 26170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:20.149401 26170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:20.149546 26170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:20.153437 26170 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:45829
I20260811 11:09:20.153467 26292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:45829 every 8 connection(s)
I20260811 11:09:20.153812 26170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:20.153968 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26170
I20260811 11:09:20.154066 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:20.154292 26508 external_mini_cluster.cc:1428] Setting key f6fd51dceeccfd5ef3a9b3f9ee36abcc
I20260811 11:09:20.155084 26293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:20.158231 26293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b: Bootstrap starting.
I20260811 11:09:20.158947 26293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:20.159296 26293 log.cc:824] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:20.160151 26293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b: No bootstrap required, opened a new log
I20260811 11:09:20.160494 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.154801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33572 (local address 127.25.227.62:45829)
0811 11:09:20.155076 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.155086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.155120 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:09:20.155722 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.155731 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.155823 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.155976 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:20.156133 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.157499 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.158242 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.158868 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.159004 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.159765 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:20.159770 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:20.159770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:20.159992 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:20.160034 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:20.160049 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:20.160122 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.160197 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.160282 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":116,"threads_started":1}
I20260811 11:09:20.162233 26293 raft_consensus.cc:348] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affcadc329134ec5b1a44a625d46644b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45829 } }
I20260811 11:09:20.162379 26293 raft_consensus.cc:374] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:20.162446 26293 raft_consensus.cc:729] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: affcadc329134ec5b1a44a625d46644b, State: Initialized, Role: FOLLOWER
I20260811 11:09:20.162565 26293 consensus_queue.cc:260] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affcadc329134ec5b1a44a625d46644b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45829 } }
I20260811 11:09:20.162662 26293 raft_consensus.cc:388] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:20.162709 26293 raft_consensus.cc:482] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:20.162768 26293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:20.163350 26293 raft_consensus.cc:504] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affcadc329134ec5b1a44a625d46644b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45829 } }
I20260811 11:09:20.163465 26293 leader_election.cc:302] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: affcadc329134ec5b1a44a625d46644b; no voters:
I20260811 11:09:20.163645 26293 leader_election.cc:288] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:20.163682 26304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:20.163838 26304 raft_consensus.cc:686] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [term 1 LEADER]: Becoming Leader. State: Replica: affcadc329134ec5b1a44a625d46644b, State: Running, Role: LEADER
I20260811 11:09:20.163944 26293 sys_catalog.cc:564] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:20.163970 26304 consensus_queue.cc:237] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affcadc329134ec5b1a44a625d46644b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45829 } }
I20260811 11:09:20.164415 26305 sys_catalog.cc:455] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "affcadc329134ec5b1a44a625d46644b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affcadc329134ec5b1a44a625d46644b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45829 } } }
I20260811 11:09:20.164433 26307 sys_catalog.cc:455] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [sys.catalog]: SysCatalogTable state changed. Reason: New leader affcadc329134ec5b1a44a625d46644b. Latest consensus state: current_term: 1 leader_uuid: "affcadc329134ec5b1a44a625d46644b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "affcadc329134ec5b1a44a625d46644b" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45829 } } }
I20260811 11:09:20.164608 26307 sys_catalog.cc:458] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:20.164594 26305 sys_catalog.cc:458] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:20.165087 26317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:20.165542 26317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:20.167001 26317 catalog_manager.cc:1347] Generated new cluster ID: 1e90653ae28c4dcc8b7118803ca856d0
I20260811 11:09:20.167057 26317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:20.177248 26317 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:20.177770 26317 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:20.180577 26317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b: Generated new TSK 0
I20260811 11:09:20.180750 26317 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:20.182380 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45829
--builtin_ntp_servers=127.25.227.20:45163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:20.286942 26345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:20.287168 26345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:20.287207 26345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:20.288452 26345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:20.288511 26345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:20.288553 26345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:20.289944 26345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:20.290230 26345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:20.290552 26345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:20.296563 26355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.296656 26357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.296563 26354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:20.297049 26345 server_base.cc:1034] running on GCE node
I20260811 11:09:20.297317 26345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:20.297602 26345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:20.298794 26345 hybrid_clock.cc:648] HybridClock initialized: now 1786446560298779 us; error 40 us; skew 500 ppm
I20260811 11:09:20.300305 26345 webserver.cc:460] Webserver started at http://127.25.227.1:36027/ using document root <none> and password file <none>
I20260811 11:09:20.300611 26345 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:20.300683 26345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:20.300827 26345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:20.302317 26345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "c5921c2d96d8476e8cffcec9fff5ee0e"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "8c42a714a453764a350a877611da8fed"
server_key_iv: "34a3e9de63a184bbbacc2e69977d2d05"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.302755 26345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "c5921c2d96d8476e8cffcec9fff5ee0e"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "8c42a714a453764a350a877611da8fed"
server_key_iv: "34a3e9de63a184bbbacc2e69977d2d05"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.304458 26345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 11:09:20.305365 26368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.305529 26345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:20.305632 26345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "c5921c2d96d8476e8cffcec9fff5ee0e"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "8c42a714a453764a350a877611da8fed"
server_key_iv: "34a3e9de63a184bbbacc2e69977d2d05"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.305709 26345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:20.337108 26345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:20.337517 26345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:20.337669 26345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:20.337920 26345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:20.338272 26345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:20.338308 26345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.338351 26345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:20.338376 26345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.344281 26345 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:33865
I20260811 11:09:20.344383 26566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:33865 every 8 connection(s)
I20260811 11:09:20.344693 26345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:09:20.349228 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26345
I20260811 11:09:20.349352 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:09:20.349550 26508 external_mini_cluster.cc:1428] Setting key a6688d3e8e795c601f20ad5c3bf0a5c7
I20260811 11:09:20.350024 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.345464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:52165 (local address 127.25.227.62:45829)
0811 11:09:20.345510 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.345512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.345771 (+ 259us) server_negotiation.cc:407] Connection header received
0811 11:09:20.346263 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.346264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.346279 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.346335 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:20.346976 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.347469 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.348374 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.348548 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.348598 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.349705 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:20.349707 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:20.349707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:20.349712 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:20.349731 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:20.349736 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:20.349802 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.349902 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.349945 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:09:20.350236 26573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.345460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45829 (local address 127.25.227.1:52165)
0811 11:09:20.345648 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.345682 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.346151 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.346387 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.346390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.346398 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:20.346909 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.346913 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.347547 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.347548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.348302 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.348304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.348617 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.348618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.348722 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.349529 (+ 807us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:20.349530 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:20.349558 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:20.349581 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:20.349817 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:20.349823 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:20.349827 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.349901 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.350015 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260811 11:09:20.350670 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45829
--builtin_ntp_servers=127.25.227.20:45163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:09:20.350740 26567 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45829
I20260811 11:09:20.350831 26567 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:20.351014 26567 heartbeater.cc:511] Master 127.25.227.62:45829 requested a full tablet report, sending...
I20260811 11:09:20.351557 26227 ts_manager.cc:194] Registered new tserver with Master: c5921c2d96d8476e8cffcec9fff5ee0e (127.25.227.1:33865)
I20260811 11:09:20.352469 26227 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.1:52165
W20260811 11:09:20.435384 26575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:20.435581 26575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:20.435602 26575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:20.436745 26575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:20.436795 26575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:20.436841 26575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:20.438271 26575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:20.438506 26575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:20.438791 26575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:20.443820 26587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.443821 26585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.443917 26590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:20.444159 26575 server_base.cc:1034] running on GCE node
I20260811 11:09:20.444376 26575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:20.444571 26575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:20.445703 26575 hybrid_clock.cc:648] HybridClock initialized: now 1786446560445681 us; error 42 us; skew 500 ppm
I20260811 11:09:20.446986 26575 webserver.cc:460] Webserver started at http://127.25.227.2:43883/ using document root <none> and password file <none>
I20260811 11:09:20.447259 26575 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:20.447310 26575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:20.447484 26575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:20.448546 26575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "abd4cd95cb24426bafb40e7a3617f1ca"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "8813d5b8ae3b674fcd98f7b9512018cb"
server_key_iv: "87ed58a2caec2ae8cae2ac6a45d3c450"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.448910 26575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "abd4cd95cb24426bafb40e7a3617f1ca"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "8813d5b8ae3b674fcd98f7b9512018cb"
server_key_iv: "87ed58a2caec2ae8cae2ac6a45d3c450"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.450350 26575 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:20.451052 26602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.451228 26575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:20.451325 26575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "abd4cd95cb24426bafb40e7a3617f1ca"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "8813d5b8ae3b674fcd98f7b9512018cb"
server_key_iv: "87ed58a2caec2ae8cae2ac6a45d3c450"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.451399 26575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:20.467695 26575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:20.468005 26575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:20.468153 26575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:20.468396 26575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:20.468739 26575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:20.468793 26575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.468829 26575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:20.468856 26575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.474563 26575 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:39813
I20260811 11:09:20.474608 26796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:39813 every 8 connection(s)
I20260811 11:09:20.474952 26575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:09:20.476722 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26575
I20260811 11:09:20.476840 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:09:20.477066 26508 external_mini_cluster.cc:1428] Setting key a239ff9284114d65e7b2dd937b0a32e1
I20260811 11:09:20.478133 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45829
--builtin_ntp_servers=127.25.227.20:45163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:09:20.481293 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.475697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:33821 (local address 127.25.227.62:45829)
0811 11:09:20.475765 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.475768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.476046 (+ 278us) server_negotiation.cc:407] Connection header received
0811 11:09:20.476546 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.476548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.476559 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.476606 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:20.477569 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.478168 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.479741 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.479933 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.480031 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.480928 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:20.480930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:20.480930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:20.480935 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:20.480951 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:20.480955 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:20.481021 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.481109 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.481132 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 11:09:20.481567 26801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.475708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45829 (local address 127.25.227.2:33821)
0811 11:09:20.475912 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.475948 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.476436 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.476683 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.476688 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.476699 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:20.477477 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.477484 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.478390 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.478391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.479646 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.479650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.480034 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.480035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.480194 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.480769 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:20.480770 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:20.480799 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:20.480822 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:20.481021 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:20.481028 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:20.481032 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.481104 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.481289 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260811 11:09:20.482049 26799 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45829
I20260811 11:09:20.482143 26799 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:20.482339 26799 heartbeater.cc:511] Master 127.25.227.62:45829 requested a full tablet report, sending...
I20260811 11:09:20.482738 26227 ts_manager.cc:194] Registered new tserver with Master: abd4cd95cb24426bafb40e7a3617f1ca (127.25.227.2:39813)
I20260811 11:09:20.483178 26227 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.2:33821
W20260811 11:09:20.563212 26806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:20.563517 26806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:20.563556 26806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:20.565271 26806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:20.565315 26806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:20.565341 26806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:20.566659 26806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:20.566895 26806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:20.567166 26806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:20.572335 26820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.572359 26817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:20.572342 26816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:20.572533 26806 server_base.cc:1034] running on GCE node
I20260811 11:09:20.572791 26806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:20.573002 26806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:20.574199 26806 hybrid_clock.cc:648] HybridClock initialized: now 1786446560574187 us; error 29 us; skew 500 ppm
I20260811 11:09:20.575580 26806 webserver.cc:460] Webserver started at http://127.25.227.3:43531/ using document root <none> and password file <none>
I20260811 11:09:20.575825 26806 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:20.575874 26806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:20.576048 26806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:20.577344 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "4fad9b8dc1514d2291e29f3e22ac66ae"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "6c7bb39c4db61062dc2f0d199d50f9e0"
server_key_iv: "a62fc90d90579693a950938997dd265d"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.577713 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "4fad9b8dc1514d2291e29f3e22ac66ae"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "6c7bb39c4db61062dc2f0d199d50f9e0"
server_key_iv: "a62fc90d90579693a950938997dd265d"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.579023 26806 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:20.579730 26845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.579916 26806 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:20.580029 26806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "4fad9b8dc1514d2291e29f3e22ac66ae"
format_stamp: "Formatted at 2026-08-11 11:09:20 on dist-test-slave-z8x9"
server_key: "6c7bb39c4db61062dc2f0d199d50f9e0"
server_key_iv: "a62fc90d90579693a950938997dd265d"
server_key_version: "encryptionkey@0"
I20260811 11:09:20.580106 26806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:20.599370 26806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:20.599699 26806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:20.599856 26806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:20.600100 26806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:20.600447 26806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:20.600500 26806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.600541 26806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:20.600569 26806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:20.606534 26806 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:40399
I20260811 11:09:20.606588 27033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:40399 every 8 connection(s)
I20260811 11:09:20.606910 26806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:09:20.612290 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.607636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:41037 (local address 127.25.227.62:45829)
0811 11:09:20.607693 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.607695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.607931 (+ 236us) server_negotiation.cc:407] Connection header received
0811 11:09:20.608466 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.608467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.608481 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.608559 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:20.609348 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.609862 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.610871 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.611069 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.611144 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.611987 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:20.611988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:20.611989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:20.611993 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:20.612014 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:20.612018 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:20.612075 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.612179 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.612207 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 11:09:20.612520 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.607634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45829 (local address 127.25.227.3:41037)
0811 11:09:20.607814 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.607848 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.608363 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.608672 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.608676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.608685 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:20.609251 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.609257 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.609962 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.609964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.610765 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.610767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.611151 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.611153 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.611299 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.611845 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:20.611846 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:20.611873 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:20.611895 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:20.612077 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:20.612083 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:20.612087 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.612166 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.612290 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260811 11:09:20.613070 27034 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45829
I20260811 11:09:20.613152 27034 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:20.613385 27034 heartbeater.cc:511] Master 127.25.227.62:45829 requested a full tablet report, sending...
I20260811 11:09:20.613797 26227 ts_manager.cc:194] Registered new tserver with Master: 4fad9b8dc1514d2291e29f3e22ac66ae (127.25.227.3:40399)
I20260811 11:09:20.614117 26227 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.3:41037
I20260811 11:09:20.614948 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 26806
I20260811 11:09:20.615041 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:09:20.615185 26508 external_mini_cluster.cc:1428] Setting key 465199b6679c3a48f6052733b77ad3ca
I20260811 11:09:20.616007 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:09:20.620055 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.617266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33586 (local address 127.25.227.62:45829)
0811 11:09:20.617302 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.617304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.617455 (+ 151us) server_negotiation.cc:407] Connection header received
0811 11:09:20.617529 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.617530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.617539 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.617578 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:20.617757 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.618206 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.618952 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.619141 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.619212 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.619811 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:20.619813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:20.619813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:20.619818 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:20.619831 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:20.619835 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:20.619884 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.619955 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.619974 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:09:20.621554 26227 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:09:20.623100 26227 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:09:20.629089 27068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.625103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:39813 (local address 127.0.0.1:49568)
0811 11:09:20.625510 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.625519 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.625559 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.625971 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.625972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.625974 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:20.626009 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.626010 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.627231 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.627233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.628051 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.628053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.628870 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.628871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.628930 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.628941 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.629000 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.629038 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":3,"thread_start_us":123,"threads_started":1}
I20260811 11:09:20.629137 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.625224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.25.227.2:39813)
0811 11:09:20.625678 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.625682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.625690 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:09:20.625726 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.625728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.625742 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.625844 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:20.626094 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.627171 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.628136 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.628793 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.628871 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.628959 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.629013 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.629048 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":95,"threads_started":1}
I20260811 11:09:20.629720 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.625102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:33865 (local address 127.0.0.1:55930)
0811 11:09:20.625287 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.625328 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.625394 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.625740 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.625747 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.625750 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:20.625798 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.625799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.627164 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.627165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.628303 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.628306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.629494 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.629495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.629555 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.629559 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.629621 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.629658 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":8,"thread_start_us":94,"threads_started":1}
I20260811 11:09:20.629776 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.625339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55930 (local address 127.25.227.1:33865)
0811 11:09:20.625569 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.625574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.625584 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:20.625627 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.625629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.625645 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.625731 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:20.625914 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.627082 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.628391 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.629114 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.629208 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.629304 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.629649 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.629693 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":102,"threads_started":1}
I20260811 11:09:20.629884 26678 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad86583aa57494eb7d66cbd56510123 (DEFAULT_TABLE table=test-table [id=9142220b438b43a0a0dc62b1f6c17fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:20.630332 26678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ad86583aa57494eb7d66cbd56510123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:20.630427 27071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.625522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47514 (local address 127.25.227.3:40399)
0811 11:09:20.625668 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.625672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.625932 (+ 260us) server_negotiation.cc:407] Connection header received
0811 11:09:20.625977 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.625979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.625994 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.626064 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:20.626234 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.626911 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.629344 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.630049 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.630153 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.630244 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.630317 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.630352 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260811 11:09:20.630416 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.625347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:40399 (local address 127.0.0.1:47514)
0811 11:09:20.625817 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.625827 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.625874 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.626129 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.626130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.626132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:20.626176 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.626177 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.626997 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.626998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.628303 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.628306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.630157 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.630158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.630220 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.630224 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.630303 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.630346 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":38,"thread_start_us":61,"threads_started":1}
I20260811 11:09:20.633059 27072 tablet_bootstrap.cc:492] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Bootstrap starting.
I20260811 11:09:20.633651 26452 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad86583aa57494eb7d66cbd56510123 (DEFAULT_TABLE table=test-table [id=9142220b438b43a0a0dc62b1f6c17fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:20.633816 27072 tablet_bootstrap.cc:654] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:20.633863 26929 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad86583aa57494eb7d66cbd56510123 (DEFAULT_TABLE table=test-table [id=9142220b438b43a0a0dc62b1f6c17fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:20.634028 26452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ad86583aa57494eb7d66cbd56510123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:20.634146 27072 log.cc:824] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:20.634235 26929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ad86583aa57494eb7d66cbd56510123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:20.634967 27072 tablet_bootstrap.cc:492] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: No bootstrap required, opened a new log
I20260811 11:09:20.635043 27072 ts_tablet_manager.cc:1397] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 11:09:20.636718 27075 tablet_bootstrap.cc:492] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Bootstrap starting.
I20260811 11:09:20.637459 27077 tablet_bootstrap.cc:492] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: Bootstrap starting.
I20260811 11:09:20.637702 27075 tablet_bootstrap.cc:654] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:20.637683 27072 raft_consensus.cc:348] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.637853 27072 raft_consensus.cc:374] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:20.637897 27072 raft_consensus.cc:729] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd4cd95cb24426bafb40e7a3617f1ca, State: Initialized, Role: FOLLOWER
I20260811 11:09:20.638016 27072 consensus_queue.cc:260] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.638038 27075 log.cc:824] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:20.638127 27077 tablet_bootstrap.cc:654] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:20.638291 27072 ts_tablet_manager.cc:1428] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 11:09:20.638417 26799 heartbeater.cc:503] Master 127.25.227.62:45829 was elected leader, sending a full tablet report...
I20260811 11:09:20.638447 27077 log.cc:824] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:20.638804 27075 tablet_bootstrap.cc:492] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: No bootstrap required, opened a new log
I20260811 11:09:20.638880 27075 ts_tablet_manager.cc:1397] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:20.639436 27077 tablet_bootstrap.cc:492] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: No bootstrap required, opened a new log
I20260811 11:09:20.639509 27077 ts_tablet_manager.cc:1397] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:20.641585 27075 raft_consensus.cc:348] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.641739 27075 raft_consensus.cc:374] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:20.641774 27075 raft_consensus.cc:729] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fad9b8dc1514d2291e29f3e22ac66ae, State: Initialized, Role: FOLLOWER
I20260811 11:09:20.641893 27075 consensus_queue.cc:260] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.642149 27075 ts_tablet_manager.cc:1428] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 11:09:20.642191 27034 heartbeater.cc:503] Master 127.25.227.62:45829 was elected leader, sending a full tablet report...
I20260811 11:09:20.642230 27077 raft_consensus.cc:348] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.642371 27077 raft_consensus.cc:374] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:20.642395 27077 raft_consensus.cc:729] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5921c2d96d8476e8cffcec9fff5ee0e, State: Initialized, Role: FOLLOWER
I20260811 11:09:20.642527 27077 consensus_queue.cc:260] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.642793 27077 ts_tablet_manager.cc:1428] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:09:20.642851 26567 heartbeater.cc:503] Master 127.25.227.62:45829 was elected leader, sending a full tablet report...
I20260811 11:09:20.719376 27083 raft_consensus.cc:482] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:20.719507 27083 raft_consensus.cc:504] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.719947 27083 leader_election.cc:288] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5921c2d96d8476e8cffcec9fff5ee0e (127.25.227.1:33865), abd4cd95cb24426bafb40e7a3617f1ca (127.25.227.2:39813)
I20260811 11:09:20.722699 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.720183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:46353 (local address 127.25.227.1:33865)
0811 11:09:20.720236 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.720239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.720249 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:20.720302 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.720304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.720317 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.720374 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:20.720577 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.721057 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.721993 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.722357 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.722439 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.722448 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.722591 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.722632 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 11:09:20.722698 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.720112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:33865 (local address 127.25.227.3:46353)
0811 11:09:20.720156 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.720171 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.720221 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.720432 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.720434 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.720435 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:20.720499 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.720501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.721142 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.721143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.721898 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.721900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.722437 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.722439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.722519 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.722522 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.722585 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.722625 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 11:09:20.722922 27085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.720122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:39813 (local address 127.25.227.3:35345)
0811 11:09:20.720395 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.720404 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:20.720456 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:20.720599 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:20.720600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:20.720602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:20.720676 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.720677 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.721348 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.721349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.722080 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:20.722082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.722610 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.722611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:20.722683 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.722686 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:20.722761 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 11:09:20.722812 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":79,"thread_start_us":112,"threads_started":1}
I20260811 11:09:20.723002 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.720267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35345 (local address 127.25.227.2:39813)
0811 11:09:20.720310 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.720312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.720449 (+ 137us) server_negotiation.cc:407] Connection header received
0811 11:09:20.720520 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.720521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.720535 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.720594 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:20.720752 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.721264 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.722170 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.722526 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.722609 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.722618 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.722887 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.722927 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:09:20.723037 26484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad86583aa57494eb7d66cbd56510123" candidate_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" is_pre_election: true
I20260811 11:09:20.723205 26484 raft_consensus.cc:2454] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fad9b8dc1514d2291e29f3e22ac66ae in term 0.
I20260811 11:09:20.723294 26722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad86583aa57494eb7d66cbd56510123" candidate_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" is_pre_election: true
I20260811 11:09:20.723472 26722 raft_consensus.cc:2454] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fad9b8dc1514d2291e29f3e22ac66ae in term 0.
I20260811 11:09:20.723493 26849 leader_election.cc:302] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fad9b8dc1514d2291e29f3e22ac66ae, c5921c2d96d8476e8cffcec9fff5ee0e; no voters:
I20260811 11:09:20.723608 27083 raft_consensus.cc:2781] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:09:20.723688 27083 raft_consensus.cc:482] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:09:20.723737 27083 raft_consensus.cc:3037] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:20.724473 27083 raft_consensus.cc:504] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.724617 27083 leader_election.cc:288] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [CANDIDATE]: Term 1 election: Requested vote from peers c5921c2d96d8476e8cffcec9fff5ee0e (127.25.227.1:33865), abd4cd95cb24426bafb40e7a3617f1ca (127.25.227.2:39813)
I20260811 11:09:20.724768 26722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad86583aa57494eb7d66cbd56510123" candidate_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd4cd95cb24426bafb40e7a3617f1ca"
I20260811 11:09:20.724802 26484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ad86583aa57494eb7d66cbd56510123" candidate_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e"
I20260811 11:09:20.724861 26722 raft_consensus.cc:3037] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:20.724889 26484 raft_consensus.cc:3037] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 0 FOLLOWER]: Advancing to term 1
W20260811 11:09:20.725457 26800 tablet.cc:2369] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:09:20.725791 26484 raft_consensus.cc:2454] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fad9b8dc1514d2291e29f3e22ac66ae in term 1.
I20260811 11:09:20.725814 26722 raft_consensus.cc:2454] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fad9b8dc1514d2291e29f3e22ac66ae in term 1.
I20260811 11:09:20.725963 26849 leader_election.cc:302] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fad9b8dc1514d2291e29f3e22ac66ae, c5921c2d96d8476e8cffcec9fff5ee0e; no voters:
I20260811 11:09:20.726054 27083 raft_consensus.cc:2781] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:20.726188 27083 raft_consensus.cc:686] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 1 LEADER]: Becoming Leader. State: Replica: 4fad9b8dc1514d2291e29f3e22ac66ae, State: Running, Role: LEADER
I20260811 11:09:20.726295 27083 consensus_queue.cc:237] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } }
I20260811 11:09:20.727108 26227 catalog_manager.cc:5495] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fad9b8dc1514d2291e29f3e22ac66ae (127.25.227.3). New cstate: current_term: 1 leader_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fad9b8dc1514d2291e29f3e22ac66ae" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 40399 } health_report { overall_health: HEALTHY } } }
I20260811 11:09:20.748037 27071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.745560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47516 (local address 127.25.227.3:40399)
0811 11:09:20.745618 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:20.745620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:20.745630 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:20.745718 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:20.745719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:20.745739 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:20.745826 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:20.745976 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.746449 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.747212 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:20.747412 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:20.747488 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:20.747647 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:20.747763 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:20.747849 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:20.747901 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 11:09:20.747920 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:09:20.750033 26722 raft_consensus.cc:1261] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 1 FOLLOWER]: Refusing update from remote peer 4fad9b8dc1514d2291e29f3e22ac66ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:20.750048 26484 raft_consensus.cc:1261] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 1 FOLLOWER]: Refusing update from remote peer 4fad9b8dc1514d2291e29f3e22ac66ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:20.750411 27083 consensus_queue.cc:1035] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5921c2d96d8476e8cffcec9fff5ee0e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 33865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:20.750566 27086 consensus_queue.cc:1035] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd4cd95cb24426bafb40e7a3617f1ca" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 39813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:20.752894 27090 mvcc.cc:205] Tried to move back new op lower bound from 7317285112829505536 to 7317285112735678464. Current Snapshot: MvccSnapshot[applied={T|T < 7317285112829505536}]
I20260811 11:09:20.753159 27092 mvcc.cc:205] Tried to move back new op lower bound from 7317285112829505536 to 7317285112735678464. Current Snapshot: MvccSnapshot[applied={T|T < 7317285112829505536}]
I20260811 11:09:20.755843 26225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:20.755944 26225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:20.756696 26225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P affcadc329134ec5b1a44a625d46644b: Sending DeleteTablet for 3 replicas of tablet 5ad86583aa57494eb7d66cbd56510123
I20260811 11:09:20.757032 26452 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ad86583aa57494eb7d66cbd56510123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:20 UTC) from {username='slave'} at 127.0.0.1:55930
I20260811 11:09:20.757066 26678 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ad86583aa57494eb7d66cbd56510123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:20 UTC) from {username='slave'} at 127.0.0.1:49568
I20260811 11:09:20.757296 27108 tablet_replica.cc:330] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: stopping tablet replica
I20260811 11:09:20.757402 27108 raft_consensus.cc:2229] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:20.757531 27108 raft_consensus.cc:2258] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:20.757536 26929 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ad86583aa57494eb7d66cbd56510123 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:20 UTC) from {username='slave'} at 127.0.0.1:47514
I20260811 11:09:20.757809 27111 tablet_replica.cc:330] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: stopping tablet replica
I20260811 11:09:20.757923 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26345
I20260811 11:09:20.757949 27111 raft_consensus.cc:2229] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:09:20.758003 27108 ts_tablet_manager.cc:1905] T 5ad86583aa57494eb7d66cbd56510123 P c5921c2d96d8476e8cffcec9fff5ee0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:20.758191 27111 raft_consensus.cc:2258] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:20.768524 27111 ts_tablet_manager.cc:1905] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:20.769335 27109 tablet_replica.cc:330] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: stopping tablet replica
I20260811 11:09:20.769541 27109 raft_consensus.cc:2229] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:20.769718 27109 raft_consensus.cc:2258] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:20.770263 27109 ts_tablet_manager.cc:1905] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:20.770292 27111 ts_tablet_manager.cc:1918] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:20.770365 27111 log.cc:1196] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/5ad86583aa57494eb7d66cbd56510123
I20260811 11:09:20.770641 27111 ts_tablet_manager.cc:1939] T 5ad86583aa57494eb7d66cbd56510123 P 4fad9b8dc1514d2291e29f3e22ac66ae: Deleting consensus metadata
I20260811 11:09:20.771112 26204 catalog_manager.cc:4841] TS 4fad9b8dc1514d2291e29f3e22ac66ae (127.25.227.3:40399): tablet 5ad86583aa57494eb7d66cbd56510123 (table test-table [id=9142220b438b43a0a0dc62b1f6c17fa4]) successfully deleted
I20260811 11:09:20.772554 27109 ts_tablet_manager.cc:1918] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:20.772639 27109 log.cc:1196] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/5ad86583aa57494eb7d66cbd56510123
I20260811 11:09:20.772884 27109 ts_tablet_manager.cc:1939] T 5ad86583aa57494eb7d66cbd56510123 P abd4cd95cb24426bafb40e7a3617f1ca: Deleting consensus metadata
I20260811 11:09:20.773334 26204 catalog_manager.cc:4841] TS abd4cd95cb24426bafb40e7a3617f1ca (127.25.227.2:39813): tablet 5ad86583aa57494eb7d66cbd56510123 (table test-table [id=9142220b438b43a0a0dc62b1f6c17fa4]) successfully deleted
W20260811 11:09:20.774202 26207 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:33865 (error 108)
I20260811 11:09:20.774480 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26575
I20260811 11:09:20.776715 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:20.774617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:33865 (local address 127.0.0.1:55934)
0811 11:09:20.776619 (+ 2002us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:20.776673 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:33865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1976}
W20260811 11:09:20.778113 26207 catalog_manager.cc:4584] TS c5921c2d96d8476e8cffcec9fff5ee0e (127.25.227.1:33865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5ad86583aa57494eb7d66cbd56510123: Network error: Client connection negotiation failed: client connection to 127.25.227.1:33865: connect: Connection refused (error 111)
I20260811 11:09:20.785542 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26806
I20260811 11:09:20.797760 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 26170
2026-08-11T11:09:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (794 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:20 dist-test-slave-z8x9 krb5kdc[27116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:20 dist-test-slave-z8x9 krb5kdc[27116](info): set up 2 sockets
Aug 11 11:09:20 dist-test-slave-z8x9 krb5kdc[27116](info): commencing operation
krb5kdc: starting...
W20260811 11:09:22.098580 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:22.220332 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43027
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:43027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:22.303543 27138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:22.303794 27138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:22.303831 27138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:22.304962 27138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:22.305037 27138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:22.305058 27138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:22.305079 27138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:22.305111 27138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:22.306660 27138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:43027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:22.306937 27138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:22.307173 27138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:22.312177 27158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:22.312201 27152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:22.312219 27138 server_base.cc:1034] running on GCE node
W20260811 11:09:22.312186 27154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:22.312739 27138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:22.313056 27138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:22.314216 27138 hybrid_clock.cc:648] HybridClock initialized: now 1786446562314228 us; error 77 us; skew 500 ppm
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:22.320598 27138 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:22.321084 27138 webserver.cc:460] Webserver started at http://127.25.227.62:39141/ using document root <none> and password file <none>
I20260811 11:09:22.321372 27138 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:22.321441 27138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:22.321585 27138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:22.322629 27138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "4ae584d6f68d451e88e8307367fb3b1f"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "3c4181bf77e22cc134fd9e3e637456d7"
server_key_iv: "ed3d4506f9c49ec02845a62b5997aa38"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.322986 27138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "4ae584d6f68d451e88e8307367fb3b1f"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "3c4181bf77e22cc134fd9e3e637456d7"
server_key_iv: "ed3d4506f9c49ec02845a62b5997aa38"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.324321 27138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:22.325062 27169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.325244 27138 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:22.325351 27138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "4ae584d6f68d451e88e8307367fb3b1f"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "3c4181bf77e22cc134fd9e3e637456d7"
server_key_iv: "ed3d4506f9c49ec02845a62b5997aa38"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.325423 27138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:22.343596 27138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:22.346046 27138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:22.346217 27138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:22.350412 27138 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:43027
I20260811 11:09:22.350449 27259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:43027 every 8 connection(s)
I20260811 11:09:22.350893 27138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:22.351796 27260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:22.354215 27260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f: Bootstrap starting.
I20260811 11:09:22.354822 27260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:22.355131 27260 log.cc:824] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:22.355540 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27138
I20260811 11:09:22.355677 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:22.355881 26508 external_mini_cluster.cc:1428] Setting key 166bab955dc806eb1ed7b414495e7cfd
I20260811 11:09:22.356004 27260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f: No bootstrap required, opened a new log
I20260811 11:09:22.358528 27260 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae584d6f68d451e88e8307367fb3b1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43027 } }
I20260811 11:09:22.358690 27260 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:22.358739 27260 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae584d6f68d451e88e8307367fb3b1f, State: Initialized, Role: FOLLOWER
I20260811 11:09:22.358878 27260 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae584d6f68d451e88e8307367fb3b1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43027 } }
I20260811 11:09:22.358973 27260 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:22.359016 27260 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:22.359066 27260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:22.359627 27260 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae584d6f68d451e88e8307367fb3b1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43027 } }
I20260811 11:09:22.359753 27260 leader_election.cc:302] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ae584d6f68d451e88e8307367fb3b1f; no voters:
I20260811 11:09:22.359947 27260 leader_election.cc:288] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:22.359987 27273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:22.360175 27273 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [term 1 LEADER]: Becoming Leader. State: Replica: 4ae584d6f68d451e88e8307367fb3b1f, State: Running, Role: LEADER
I20260811 11:09:22.360234 27260 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:22.360308 27273 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae584d6f68d451e88e8307367fb3b1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43027 } }
I20260811 11:09:22.360627 27273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ae584d6f68d451e88e8307367fb3b1f. Latest consensus state: current_term: 1 leader_uuid: "4ae584d6f68d451e88e8307367fb3b1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae584d6f68d451e88e8307367fb3b1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43027 } } }
I20260811 11:09:22.360718 27273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:22.360642 27275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ae584d6f68d451e88e8307367fb3b1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ae584d6f68d451e88e8307367fb3b1f" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43027 } } }
I20260811 11:09:22.360824 27275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:22.361603 27283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:22.362171 27283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:22.364159 27283 catalog_manager.cc:1347] Generated new cluster ID: e386418b4538487684dd64eddce942af
I20260811 11:09:22.364213 27283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:22.368788 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.356415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54168 (local address 127.25.227.62:43027)
0811 11:09:22.356578 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.356586 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.356616 (+ 30us) server_negotiation.cc:407] Connection header received
0811 11:09:22.357447 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.357455 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.357508 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.357623 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:22.358487 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.359826 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.360949 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.361678 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.361773 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.364862 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:22.364867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:22.364868 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:22.364880 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:22.366939 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.367332 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.367335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.367335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.367433 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.367601 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.367601 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.367602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.367881 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:22.368019 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.368463 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.368591 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260811 11:09:22.371037 27283 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:22.371841 27283 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:22.376839 27283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f: Generated new TSK 0
I20260811 11:09:22.377018 27283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:09:22.407529 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43027
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:22.492883 27310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:22.493089 27310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:22.493113 27310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:22.494283 27310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:22.494328 27310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:22.494354 27310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:22.495872 27310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:22.496117 27310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:22.496352 27310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:22.501442 27320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:22.501477 27318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:22.501492 27317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:22.501729 27310 server_base.cc:1034] running on GCE node
I20260811 11:09:22.501943 27310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:22.502172 27310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:22.503312 27310 hybrid_clock.cc:648] HybridClock initialized: now 1786446562503291 us; error 34 us; skew 500 ppm
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:22.505852 27310 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:09:22.506331 27310 webserver.cc:460] Webserver started at http://127.25.227.1:42455/ using document root <none> and password file <none>
I20260811 11:09:22.506572 27310 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:22.506641 27310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:22.506796 27310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:22.507813 27310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "81e48858d7ac46179f9e4ff9a840ad63"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "b05443eff9f809ee81fa43973fa858ca"
server_key_iv: "8341689921e264c9d561c43dc0d2a6a4"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.508178 27310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "81e48858d7ac46179f9e4ff9a840ad63"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "b05443eff9f809ee81fa43973fa858ca"
server_key_iv: "8341689921e264c9d561c43dc0d2a6a4"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.509572 27310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:22.510317 27331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.510500 27310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:22.510602 27310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "81e48858d7ac46179f9e4ff9a840ad63"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "b05443eff9f809ee81fa43973fa858ca"
server_key_iv: "8341689921e264c9d561c43dc0d2a6a4"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.510672 27310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:22.527208 27310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:22.529325 27310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:22.529482 27310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:22.529711 27310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:22.530023 27310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:22.530073 27310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.530114 27310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:22.530143 27310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.535984 27310 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:39923
I20260811 11:09:22.536041 27519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:39923 every 8 connection(s)
I20260811 11:09:22.536350 27310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:22.543503 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27310
I20260811 11:09:22.543644 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:09:22.543919 26508 external_mini_cluster.cc:1428] Setting key 9a7e69c5d3d223c4abd069bd158272e0
I20260811 11:09:22.545818 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.537060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:40331 (local address 127.25.227.62:43027)
0811 11:09:22.537108 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.537110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.537343 (+ 233us) server_negotiation.cc:407] Connection header received
0811 11:09:22.537862 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.537863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.537876 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.537935 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:22.538878 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.539394 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.540386 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.540590 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.540666 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.542762 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:22.542764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:22.542764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:22.542772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:22.544302 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.544788 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.544789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.544790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.544853 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.545101 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.545102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.545102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.545280 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:22.545349 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.545625 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.545717 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:09:22.546010 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.537015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43027 (local address 127.25.227.1:40331)
0811 11:09:22.537208 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.537263 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.537759 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.538001 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.538005 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.538584 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:22.538778 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.538784 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.539492 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.539493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.540292 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.540294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.540675 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.540677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.540806 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.541323 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:22.541331 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:22.542667 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:22.544391 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:22.544398 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:22.544400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:22.544693 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:22.544918 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:22.544919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:22.544920 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:22.545035 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:22.545351 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:22.545359 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:22.545498 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.545604 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.545766 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":73,"threads_started":1}
I20260811 11:09:22.546531 27520 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43027
I20260811 11:09:22.546627 27520 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:22.546821 27520 heartbeater.cc:511] Master 127.25.227.62:43027 requested a full tablet report, sending...
I20260811 11:09:22.547390 27187 ts_manager.cc:194] Registered new tserver with Master: 81e48858d7ac46179f9e4ff9a840ad63 (127.25.227.1:39923)
I20260811 11:09:22.548157 27187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:40331
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:09:22.570282 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43027
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:22.653090 27525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:22.653312 27525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:22.653337 27525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:22.654429 27525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:22.654469 27525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:22.654495 27525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:22.655937 27525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:22.656121 27525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:22.656308 27525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:22.661487 27534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:22.661736 27525 server_base.cc:1034] running on GCE node
W20260811 11:09:22.661667 27533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:22.661513 27538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:22.662173 27525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:22.662431 27525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:22.663594 27525 hybrid_clock.cc:648] HybridClock initialized: now 1786446562663572 us; error 39 us; skew 500 ppm
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:22.666618 27525 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:09:22.667186 27525 webserver.cc:460] Webserver started at http://127.25.227.2:34755/ using document root <none> and password file <none>
I20260811 11:09:22.667512 27525 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:22.667584 27525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:22.667729 27525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:22.669133 27525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "65e18c3ab9af4d16bda1a6f6251cf240"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "153c1973bf2fa16b2c7984de6fd9eb3f"
server_key_iv: "71ff75bde29000bf3e81502865c48d9d"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.669631 27525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "65e18c3ab9af4d16bda1a6f6251cf240"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "153c1973bf2fa16b2c7984de6fd9eb3f"
server_key_iv: "71ff75bde29000bf3e81502865c48d9d"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.671103 27525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:22.671862 27547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.672052 27525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:22.672138 27525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "65e18c3ab9af4d16bda1a6f6251cf240"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "153c1973bf2fa16b2c7984de6fd9eb3f"
server_key_iv: "71ff75bde29000bf3e81502865c48d9d"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.672212 27525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:22.685866 27525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:22.688156 27525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:22.688318 27525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:22.688560 27525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:22.688874 27525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:22.688910 27525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.688948 27525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:22.688977 27525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.694926 27525 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:46841
I20260811 11:09:22.695003 27739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:46841 every 8 connection(s)
I20260811 11:09:22.695312 27525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:09:22.695713 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27525
I20260811 11:09:22.695853 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:09:22.696031 26508 external_mini_cluster.cc:1428] Setting key 3f16335995058b410653aef445f3c115
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
I20260811 11:09:22.705142 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.696070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:41693 (local address 127.25.227.62:43027)
0811 11:09:22.696146 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.696148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.696405 (+ 257us) server_negotiation.cc:407] Connection header received
0811 11:09:22.697038 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.697039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.697048 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.697087 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:22.698458 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.698943 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.699938 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.700131 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.700204 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.702388 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:22.702390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:22.702391 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:22.702398 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:22.703780 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.704192 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.704193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.704194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.704257 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.704502 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.704503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.704503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.704618 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:22.704693 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.704967 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.705049 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 11:09:22.705348 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.696030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43027 (local address 127.25.227.2:41693)
0811 11:09:22.696230 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.696288 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.696935 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.697203 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.697207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.698070 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:22.698354 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.698361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.699044 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.699046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.699844 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.699847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.700213 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.700214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.700350 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.700851 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:22.700860 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:22.702293 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:22.703879 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:22.703887 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:22.703889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:22.704117 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:22.704328 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:22.704329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:22.704329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:22.704436 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:22.704684 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:22.704690 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:22.704830 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.704930 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.705089 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260811 11:09:22.705825 27740 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43027
I20260811 11:09:22.705932 27740 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:22.706110 27740 heartbeater.cc:511] Master 127.25.227.62:43027 requested a full tablet report, sending...
I20260811 11:09:22.706502 27187 ts_manager.cc:194] Registered new tserver with Master: 65e18c3ab9af4d16bda1a6f6251cf240 (127.25.227.2:46841)
I20260811 11:09:22.706935 27187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:41693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:09:22.721939 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43027
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:38517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:22.804603 27747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:22.804831 27747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:22.804857 27747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:22.806027 27747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:22.806071 27747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:22.806123 27747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:22.807663 27747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:38517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:43027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:22.807911 27747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:22.808146 27747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:09:22.813405 27747 server_base.cc:1034] running on GCE node
W20260811 11:09:22.813375 27756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:22.813369 27755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:22.813387 27759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:22.813882 27747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:22.814167 27747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:22.815327 27747 hybrid_clock.cc:648] HybridClock initialized: now 1786446562815320 us; error 33 us; skew 500 ppm
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:22.817823 27747 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:09:22.818248 27747 webserver.cc:460] Webserver started at http://127.25.227.3:38121/ using document root <none> and password file <none>
I20260811 11:09:22.818476 27747 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:22.818542 27747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:22.818688 27747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:22.819717 27747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "9f60e4669d344f5cb74ac128518d4fd9"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "f81d9fb7b42eb1e440c204965751a05a"
server_key_iv: "faea301d04ad6c9151b0cad52f19349b"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.820086 27747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "9f60e4669d344f5cb74ac128518d4fd9"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "f81d9fb7b42eb1e440c204965751a05a"
server_key_iv: "faea301d04ad6c9151b0cad52f19349b"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.821424 27747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:22.822113 27775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.822290 27747 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:22.822391 27747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "9f60e4669d344f5cb74ac128518d4fd9"
format_stamp: "Formatted at 2026-08-11 11:09:22 on dist-test-slave-z8x9"
server_key: "f81d9fb7b42eb1e440c204965751a05a"
server_key_iv: "faea301d04ad6c9151b0cad52f19349b"
server_key_version: "encryptionkey@0"
I20260811 11:09:22.822458 27747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:22.840359 27747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:22.842370 27747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:22.842530 27747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:22.842764 27747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:22.843076 27747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:22.843137 27747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.843179 27747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:22.843204 27747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:22.849069 27747 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:34241
I20260811 11:09:22.849148 27963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:34241 every 8 connection(s)
I20260811 11:09:22.849499 27747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
Aug 11 11:09:22 dist-test-slave-z8x9 krb5kdc[27116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446562, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:22.857393 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 27747
I20260811 11:09:22.857527 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:09:22.857733 26508 external_mini_cluster.cc:1428] Setting key d237b59d9e049bce6ae82ebc7d7b8a70
I20260811 11:09:22.858876 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.850272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:58301 (local address 127.25.227.62:43027)
0811 11:09:22.850335 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.850342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.850553 (+ 211us) server_negotiation.cc:407] Connection header received
0811 11:09:22.851022 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.851023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.851033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.851090 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:22.851995 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.852500 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.853505 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.853702 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.853762 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.855797 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:22.855798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:22.855799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:22.855806 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:22.857268 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.857818 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.857820 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.857821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.857881 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.858206 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.858207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.858208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.858355 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:22.858423 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.858718 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.858805 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:09:22.859081 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.850249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:43027 (local address 127.25.227.3:58301)
0811 11:09:22.850422 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.850465 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.850934 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.851142 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.851145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.851721 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:22.851916 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.851921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.852581 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.852582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.853424 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.853426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.853777 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.853778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.853876 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.854342 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:22.854351 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:22.855690 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:22.857365 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:22.857373 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:22.857375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:22.857678 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:22.857971 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:22.857972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:22.857972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:22.858129 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:22.858421 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:22.858427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:22.858566 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.858686 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.858865 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260811 11:09:22.859550 27965 heartbeater.cc:347] Connected to a master server at 127.25.227.62:43027
I20260811 11:09:22.859653 27965 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:22.859827 27965 heartbeater.cc:511] Master 127.25.227.62:43027 requested a full tablet report, sending...
I20260811 11:09:22.860232 27187 ts_manager.cc:194] Registered new tserver with Master: 9f60e4669d344f5cb74ac128518d4fd9 (127.25.227.3:34241)
I20260811 11:09:22.860618 27187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:58301
I20260811 11:09:22.869544 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:09:22.876670 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.870831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59776 (local address 127.25.227.62:43027)
0811 11:09:22.870894 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.870897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.870977 (+ 80us) server_negotiation.cc:407] Connection header received
0811 11:09:22.871018 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.871018 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.871027 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.871073 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:22.871557 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.872019 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.872672 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.872850 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.872902 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.874174 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:22.874176 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:22.874176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:22.874182 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:22.875564 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.875984 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.875985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.875986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.876038 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:22.876224 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:22.876224 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:22.876225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:22.876360 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:22.876442 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.876542 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.876592 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 11:09:22.878424 27187 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:09:22.879981 27187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:09:22.886406 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.882647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:39923 (local address 127.0.0.1:58850)
0811 11:09:22.882787 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.882796 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.882842 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.883384 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.883385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.883388 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:22.883439 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.883441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.884400 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.884401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.885344 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.885346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.886182 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.886183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.886238 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.886263 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.886315 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.886353 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260811 11:09:22.886686 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.882227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:34241 (local address 127.0.0.1:54482)
0811 11:09:22.882350 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.882389 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.882451 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.882768 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.882771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.882774 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:22.882854 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.882856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.884180 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.884181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.885596 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.885597 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.886469 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.886470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.886537 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.886540 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.886594 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.886630 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":6,"thread_start_us":81,"threads_started":1}
I20260811 11:09:22.886703 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.882923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58850 (local address 127.25.227.1:39923)
0811 11:09:22.883186 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.883191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.883202 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:09:22.883256 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.883258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.883275 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.883512 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:22.883573 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.884277 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.885414 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.886104 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.886183 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.886242 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.886340 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.886384 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":85,"threads_started":1}
I20260811 11:09:22.887012 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.882318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54482 (local address 127.25.227.3:34241)
0811 11:09:22.882481 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.882486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.882497 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:09:22.882553 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.882555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.882574 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.882668 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:22.882935 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.884073 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.885679 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.886386 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.886456 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.886505 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.886893 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.886934 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260811 11:09:22.887595 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.882455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:46841 (local address 127.0.0.1:52938)
0811 11:09:22.882590 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.882604 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.882651 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.883239 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.883241 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.883243 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:22.883282 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.883283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.884491 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.884492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.885594 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.885596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.887334 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.887335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.887397 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.887401 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.887467 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.887503 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260811 11:09:22.887414 27408 tablet_service.cc:1467] Processing CreateTablet for tablet 287922a64d644b3c8abd853bc5378cb0 (DEFAULT_TABLE table=test-table [id=3e7151f6e49f4f5d9d005ecf6d3b5de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:22.887715 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.882879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.25.227.2:46841)
0811 11:09:22.883063 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.883067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.883078 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:09:22.883114 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.883116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.883132 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.883348 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:22.883419 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.884388 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.886547 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.887242 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.887331 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.887386 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.887589 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.887637 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":87,"threads_started":1}
I20260811 11:09:22.887904 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287922a64d644b3c8abd853bc5378cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:22.888329 27625 tablet_service.cc:1467] Processing CreateTablet for tablet 287922a64d644b3c8abd853bc5378cb0 (DEFAULT_TABLE table=test-table [id=3e7151f6e49f4f5d9d005ecf6d3b5de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:22.888644 27625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287922a64d644b3c8abd853bc5378cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:22.889961 27848 tablet_service.cc:1467] Processing CreateTablet for tablet 287922a64d644b3c8abd853bc5378cb0 (DEFAULT_TABLE table=test-table [id=3e7151f6e49f4f5d9d005ecf6d3b5de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:22.890326 27848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287922a64d644b3c8abd853bc5378cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:22.891415 27997 tablet_bootstrap.cc:492] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: Bootstrap starting.
I20260811 11:09:22.891719 27998 tablet_bootstrap.cc:492] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Bootstrap starting.
I20260811 11:09:22.892124 27997 tablet_bootstrap.cc:654] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:22.892591 27998 tablet_bootstrap.cc:654] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:22.892663 27997 log.cc:824] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:22.893217 27998 log.cc:824] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:22.893477 27997 tablet_bootstrap.cc:492] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: No bootstrap required, opened a new log
I20260811 11:09:22.893558 27997 ts_tablet_manager.cc:1397] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:09:22.893990 27998 tablet_bootstrap.cc:492] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: No bootstrap required, opened a new log
I20260811 11:09:22.894127 27998 ts_tablet_manager.cc:1397] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:09:22.894235 28003 tablet_bootstrap.cc:492] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Bootstrap starting.
I20260811 11:09:22.894893 28003 tablet_bootstrap.cc:654] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:22.895272 27997 raft_consensus.cc:348] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.895432 27997 raft_consensus.cc:374] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:22.895478 27997 raft_consensus.cc:729] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81e48858d7ac46179f9e4ff9a840ad63, State: Initialized, Role: FOLLOWER
I20260811 11:09:22.895468 28003 log.cc:824] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:22.895592 27997 consensus_queue.cc:260] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.895920 27997 ts_tablet_manager.cc:1428] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 11:09:22.895942 27520 heartbeater.cc:503] Master 127.25.227.62:43027 was elected leader, sending a full tablet report...
I20260811 11:09:22.896494 28003 tablet_bootstrap.cc:492] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: No bootstrap required, opened a new log
I20260811 11:09:22.896572 28003 ts_tablet_manager.cc:1397] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 11:09:22.896502 27998 raft_consensus.cc:348] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.896673 27998 raft_consensus.cc:374] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:22.896718 27998 raft_consensus.cc:729] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e18c3ab9af4d16bda1a6f6251cf240, State: Initialized, Role: FOLLOWER
I20260811 11:09:22.896849 27998 consensus_queue.cc:260] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.897140 27998 ts_tablet_manager.cc:1428] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 11:09:22.897234 27740 heartbeater.cc:503] Master 127.25.227.62:43027 was elected leader, sending a full tablet report...
I20260811 11:09:22.898542 28003 raft_consensus.cc:348] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.898674 28003 raft_consensus.cc:374] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:22.898715 28003 raft_consensus.cc:729] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f60e4669d344f5cb74ac128518d4fd9, State: Initialized, Role: FOLLOWER
I20260811 11:09:22.898821 28003 consensus_queue.cc:260] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.899089 28003 ts_tablet_manager.cc:1428] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 11:09:22.899111 27965 heartbeater.cc:503] Master 127.25.227.62:43027 was elected leader, sending a full tablet report...
I20260811 11:09:22.913269 28011 raft_consensus.cc:482] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:22.913369 28011 raft_consensus.cc:504] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.913686 28011 leader_election.cc:288] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65e18c3ab9af4d16bda1a6f6251cf240 (127.25.227.2:46841), 81e48858d7ac46179f9e4ff9a840ad63 (127.25.227.1:39923)
I20260811 11:09:22.917429 27970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.913857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:46841 (local address 127.25.227.3:35391)
0811 11:09:22.913910 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.913924 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.913966 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.914137 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.914138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.914140 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:22.914207 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.914209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.915124 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.915125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.916369 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.916372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.917108 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.917108 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.917221 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.917226 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.917285 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.917346 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":45}
I20260811 11:09:22.917517 27996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.914065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:46613 (local address 127.25.227.1:39923)
0811 11:09:22.914131 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.914133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.914278 (+ 145us) server_negotiation.cc:407] Connection header received
0811 11:09:22.914362 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.914363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.914372 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.914424 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:22.914557 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.915248 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.916539 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.917140 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.917248 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.917256 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.917397 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.917447 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:09:22.917517 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.913946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:35391 (local address 127.25.227.2:46841)
0811 11:09:22.914009 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.914012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.914022 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:22.914050 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.914051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.914060 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.914131 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:22.914294 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.915055 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.916467 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.917034 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.917113 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.917131 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.917406 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.917447 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 11:09:22.917733 28013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.913983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:39923 (local address 127.25.227.3:46613)
0811 11:09:22.914192 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.914199 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:22.914304 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:22.914433 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:22.914433 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:22.914435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:22.914496 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.914497 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.915311 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.915312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.916465 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:22.916467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.917268 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.917269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:22.917336 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.917339 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:22.917381 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 11:09:22.917411 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":127,"threads_started":1}
I20260811 11:09:22.917865 27663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287922a64d644b3c8abd853bc5378cb0" candidate_uuid: "9f60e4669d344f5cb74ac128518d4fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" is_pre_election: true
I20260811 11:09:22.918025 27663 raft_consensus.cc:2454] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f60e4669d344f5cb74ac128518d4fd9 in term 0.
I20260811 11:09:22.918046 27444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287922a64d644b3c8abd853bc5378cb0" candidate_uuid: "9f60e4669d344f5cb74ac128518d4fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81e48858d7ac46179f9e4ff9a840ad63" is_pre_election: true
I20260811 11:09:22.918182 27444 raft_consensus.cc:2454] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f60e4669d344f5cb74ac128518d4fd9 in term 0.
I20260811 11:09:22.918274 27776 leader_election.cc:302] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e18c3ab9af4d16bda1a6f6251cf240, 9f60e4669d344f5cb74ac128518d4fd9; no voters:
I20260811 11:09:22.918417 28011 raft_consensus.cc:2781] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:09:22.918504 28011 raft_consensus.cc:482] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:09:22.918540 28011 raft_consensus.cc:3037] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:22.919211 28011 raft_consensus.cc:504] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.919348 28011 leader_election.cc:288] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [CANDIDATE]: Term 1 election: Requested vote from peers 65e18c3ab9af4d16bda1a6f6251cf240 (127.25.227.2:46841), 81e48858d7ac46179f9e4ff9a840ad63 (127.25.227.1:39923)
I20260811 11:09:22.919498 27663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287922a64d644b3c8abd853bc5378cb0" candidate_uuid: "9f60e4669d344f5cb74ac128518d4fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e18c3ab9af4d16bda1a6f6251cf240"
I20260811 11:09:22.919520 27444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287922a64d644b3c8abd853bc5378cb0" candidate_uuid: "9f60e4669d344f5cb74ac128518d4fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81e48858d7ac46179f9e4ff9a840ad63"
I20260811 11:09:22.919580 27663 raft_consensus.cc:3037] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:22.919600 27444 raft_consensus.cc:3037] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:22.920300 27663 raft_consensus.cc:2454] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f60e4669d344f5cb74ac128518d4fd9 in term 1.
I20260811 11:09:22.920379 27444 raft_consensus.cc:2454] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f60e4669d344f5cb74ac128518d4fd9 in term 1.
I20260811 11:09:22.920467 27776 leader_election.cc:302] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e18c3ab9af4d16bda1a6f6251cf240, 9f60e4669d344f5cb74ac128518d4fd9; no voters:
I20260811 11:09:22.920560 28011 raft_consensus.cc:2781] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:22.920727 28011 raft_consensus.cc:686] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 1 LEADER]: Becoming Leader. State: Replica: 9f60e4669d344f5cb74ac128518d4fd9, State: Running, Role: LEADER
I20260811 11:09:22.920838 28011 consensus_queue.cc:237] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } }
I20260811 11:09:22.921667 27187 catalog_manager.cc:5495] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f60e4669d344f5cb74ac128518d4fd9 (127.25.227.3). New cstate: current_term: 1 leader_uuid: "9f60e4669d344f5cb74ac128518d4fd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60e4669d344f5cb74ac128518d4fd9" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 34241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260811 11:09:22.931671 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.929289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54488 (local address 127.25.227.3:34241)
0811 11:09:22.929344 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:22.929346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:22.929358 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:09:22.929451 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:22.929452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:22.929470 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:22.929540 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:22.929687 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.930139 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.930869 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:22.931079 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:22.931152 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:22.931312 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:22.931410 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:22.931516 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:22.931567 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 11:09:22.931577 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:09:22.933333 27663 raft_consensus.cc:1261] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 1 FOLLOWER]: Refusing update from remote peer 9f60e4669d344f5cb74ac128518d4fd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:22.933336 27444 raft_consensus.cc:1261] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63 [term 1 FOLLOWER]: Refusing update from remote peer 9f60e4669d344f5cb74ac128518d4fd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:22.933634 28011 consensus_queue.cc:1035] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e18c3ab9af4d16bda1a6f6251cf240" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:22.933805 28016 consensus_queue.cc:1035] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81e48858d7ac46179f9e4ff9a840ad63" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:22.936272 28022 mvcc.cc:205] Tried to move back new op lower bound from 7317285121772457984 to 7317285121724481536. Current Snapshot: MvccSnapshot[applied={T|T < 7317285121772457984}]
I20260811 11:09:22.937664 28021 mvcc.cc:205] Tried to move back new op lower bound from 7317285121772457984 to 7317285121724481536. Current Snapshot: MvccSnapshot[applied={T|T < 7317285121772457984 or (T in {7317285121772457984})}]
I20260811 11:09:22.938805 27186 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:22.938905 27186 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:22.939651 27186 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ae584d6f68d451e88e8307367fb3b1f: Sending DeleteTablet for 3 replicas of tablet 287922a64d644b3c8abd853bc5378cb0
I20260811 11:09:22.939963 27848 tablet_service.cc:1514] Processing DeleteTablet for tablet 287922a64d644b3c8abd853bc5378cb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:22 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:54482
I20260811 11:09:22.940088 27625 tablet_service.cc:1514] Processing DeleteTablet for tablet 287922a64d644b3c8abd853bc5378cb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:22 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:52938
I20260811 11:09:22.940133 27408 tablet_service.cc:1514] Processing DeleteTablet for tablet 287922a64d644b3c8abd853bc5378cb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:22 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:58850
I20260811 11:09:22.940183 28034 tablet_replica.cc:330] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: stopping tablet replica
I20260811 11:09:22.940267 28034 raft_consensus.cc:2229] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:09:22.940351 28034 raft_consensus.cc:2258] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:22.940618 28037 tablet_replica.cc:330] T 287922a64d644b3c8abd853bc5378cb0 P 81e48858d7ac46179f9e4ff9a840ad63: stopping tablet replica
I20260811 11:09:22.940668 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27310
I20260811 11:09:22.950063 28034 ts_tablet_manager.cc:1905] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:22.951098 28035 tablet_replica.cc:330] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: stopping tablet replica
I20260811 11:09:22.951339 28035 raft_consensus.cc:2229] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:22.951578 28035 raft_consensus.cc:2258] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:22.952181 28034 ts_tablet_manager.cc:1918] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:22.952265 28034 log.cc:1196] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/287922a64d644b3c8abd853bc5378cb0
I20260811 11:09:22.952553 28034 ts_tablet_manager.cc:1939] T 287922a64d644b3c8abd853bc5378cb0 P 9f60e4669d344f5cb74ac128518d4fd9: Deleting consensus metadata
I20260811 11:09:22.953007 27170 catalog_manager.cc:4841] TS 9f60e4669d344f5cb74ac128518d4fd9 (127.25.227.3:34241): tablet 287922a64d644b3c8abd853bc5378cb0 (table test-table [id=3e7151f6e49f4f5d9d005ecf6d3b5de4]) successfully deleted
I20260811 11:09:22.953269 28035 ts_tablet_manager.cc:1905] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:22.954865 28035 ts_tablet_manager.cc:1918] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:22.954967 28035 log.cc:1196] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/287922a64d644b3c8abd853bc5378cb0
I20260811 11:09:22.955225 28035 ts_tablet_manager.cc:1939] T 287922a64d644b3c8abd853bc5378cb0 P 65e18c3ab9af4d16bda1a6f6251cf240: Deleting consensus metadata
I20260811 11:09:22.955644 27170 catalog_manager.cc:4841] TS 65e18c3ab9af4d16bda1a6f6251cf240 (127.25.227.2:46841): tablet 287922a64d644b3c8abd853bc5378cb0 (table test-table [id=3e7151f6e49f4f5d9d005ecf6d3b5de4]) successfully deleted
W20260811 11:09:22.960528 27170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:39923 (error 108)
I20260811 11:09:22.960779 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27525
I20260811 11:09:22.974237 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:22.974057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:39923 (local address 127.0.0.1:58854)
0811 11:09:22.974117 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:22.974186 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:39923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 11:09:22.974413 27170 catalog_manager.cc:4584] TS 81e48858d7ac46179f9e4ff9a840ad63 (127.25.227.1:39923): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 287922a64d644b3c8abd853bc5378cb0: Network error: Client connection negotiation failed: client connection to 127.25.227.1:39923: connect: Connection refused (error 111)
I20260811 11:09:22.978798 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27747
I20260811 11:09:22.998142 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 27138
2026-08-11T11:09:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2199 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T11:09:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:23Z Disabled control of system clock
I20260811 11:09:23.033314 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:37005
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:43555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:37005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:23.120427 28045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:23.120692 28045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:23.120733 28045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:23.121918 28045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:23.121984 28045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:23.122005 28045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:23.122027 28045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:23.122054 28045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:23.123432 28045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:37005
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:37005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:23.123737 28045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:23.124089 28045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:23.129082 28058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.129091 28063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.129114 28059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:23.129410 28045 server_base.cc:1034] running on GCE node
I20260811 11:09:23.129698 28045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:23.129998 28045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:23.131156 28045 hybrid_clock.cc:648] HybridClock initialized: now 1786446563131131 us; error 47 us; skew 500 ppm
I20260811 11:09:23.132380 28045 webserver.cc:460] Webserver started at http://127.25.227.62:38231/ using document root <none> and password file <none>
I20260811 11:09:23.132642 28045 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:23.132710 28045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:23.132863 28045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:23.133984 28045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "fe8bde36f3ac41cabf53846c712b5e1d"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "b1567c2b0eff6b51a2d4824c242d6dc9"
server_key_iv: "3268efb4ace830f255083c1c924a0b14"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.134353 28045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "fe8bde36f3ac41cabf53846c712b5e1d"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "b1567c2b0eff6b51a2d4824c242d6dc9"
server_key_iv: "3268efb4ace830f255083c1c924a0b14"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.135656 28045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:23.136353 28073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.136523 28045 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:23.136626 28045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "fe8bde36f3ac41cabf53846c712b5e1d"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "b1567c2b0eff6b51a2d4824c242d6dc9"
server_key_iv: "3268efb4ace830f255083c1c924a0b14"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.136698 28045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:23.160138 28045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:23.160485 28045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:23.160640 28045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:23.164737 28045 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:37005
I20260811 11:09:23.164776 28165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:37005 every 8 connection(s)
I20260811 11:09:23.165133 28045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:23.166148 28166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:23.168090 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28045
I20260811 11:09:23.168195 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:23.168437 26508 external_mini_cluster.cc:1428] Setting key 9b7c560124d5417b88fea8660e0747e3
I20260811 11:09:23.168754 28166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d: Bootstrap starting.
I20260811 11:09:23.169600 28166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:23.169911 28166 log.cc:824] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:23.170594 28166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d: No bootstrap required, opened a new log
I20260811 11:09:23.172355 28166 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37005 } }
I20260811 11:09:23.172508 28166 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:23.172561 28166 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8bde36f3ac41cabf53846c712b5e1d, State: Initialized, Role: FOLLOWER
I20260811 11:09:23.172689 28166 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37005 } }
I20260811 11:09:23.172758 28166 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:23.172780 28166 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:23.172849 28166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:23.173446 28166 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37005 } }
I20260811 11:09:23.173563 28166 leader_election.cc:302] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe8bde36f3ac41cabf53846c712b5e1d; no voters:
I20260811 11:09:23.173768 28166 leader_election.cc:288] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:23.173806 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.168950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45590 (local address 127.25.227.62:37005)
0811 11:09:23.169187 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.169196 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.169230 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:09:23.169630 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.169661 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.169743 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.169876 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:23.170098 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.170998 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.171755 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.172153 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.172300 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.173044 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:23.173048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:23.173048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:23.173274 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:23.173309 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:23.173319 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:23.173389 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.173464 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.173542 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":67,"threads_started":1}
I20260811 11:09:23.173813 28180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:23.174000 28180 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [term 1 LEADER]: Becoming Leader. State: Replica: fe8bde36f3ac41cabf53846c712b5e1d, State: Running, Role: LEADER
I20260811 11:09:23.174026 28166 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:23.174145 28180 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37005 } }
I20260811 11:09:23.174538 28182 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe8bde36f3ac41cabf53846c712b5e1d. Latest consensus state: current_term: 1 leader_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37005 } } }
I20260811 11:09:23.174635 28182 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:23.174861 28189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:23.175338 28189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:23.175755 28181 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe8bde36f3ac41cabf53846c712b5e1d" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 37005 } } }
I20260811 11:09:23.175853 28181 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:23.176968 28189 catalog_manager.cc:1347] Generated new cluster ID: a82569d3d01e4b01a2d735fd9685b7db
I20260811 11:09:23.177026 28189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:23.197472 28189 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:23.198215 28189 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:23.200760 28189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d: Generated new TSK 0
I20260811 11:09:23.200963 28189 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:23.204622 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37005
--builtin_ntp_servers=127.25.227.20:43555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:23.290498 28209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:23.290709 28209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:23.290731 28209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:23.291873 28209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:23.291915 28209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:23.291940 28209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:23.293438 28209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:23.293685 28209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:23.293989 28209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:23.299877 28219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.299888 28222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.299888 28217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:23.300680 28209 server_base.cc:1034] running on GCE node
I20260811 11:09:23.300856 28209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:23.301048 28209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:23.302191 28209 hybrid_clock.cc:648] HybridClock initialized: now 1786446563302175 us; error 32 us; skew 500 ppm
I20260811 11:09:23.303426 28209 webserver.cc:460] Webserver started at http://127.25.227.1:35655/ using document root <none> and password file <none>
I20260811 11:09:23.303618 28209 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:23.303671 28209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:23.303773 28209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:23.304802 28209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "d7456f21d330412fba1bc6e91ea15787"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "7c798d7e1e346e56beb7ce1bda47aecd"
server_key_iv: "8d01e372949d219d0a9c8e602c8cc279"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.305107 28209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "d7456f21d330412fba1bc6e91ea15787"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "7c798d7e1e346e56beb7ce1bda47aecd"
server_key_iv: "8d01e372949d219d0a9c8e602c8cc279"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.306452 28209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:23.307137 28234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.307319 28209 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:23.307407 28209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "d7456f21d330412fba1bc6e91ea15787"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "7c798d7e1e346e56beb7ce1bda47aecd"
server_key_iv: "8d01e372949d219d0a9c8e602c8cc279"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.307464 28209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:23.327950 28209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:23.328248 28209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:23.328357 28209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:23.328562 28209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:23.328891 28209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:23.328926 28209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.328950 28209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:23.328962 28209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.335040 28209 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:42937
I20260811 11:09:23.335086 28435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:42937 every 8 connection(s)
I20260811 11:09:23.335441 28209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:09:23.340706 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.336228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:50441 (local address 127.25.227.62:37005)
0811 11:09:23.336311 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.336313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.336539 (+ 226us) server_negotiation.cc:407] Connection header received
0811 11:09:23.337020 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.337021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.337031 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.337085 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:23.337866 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.338390 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.339366 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.339597 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.339659 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.340433 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:23.340434 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:23.340435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:23.340439 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:23.340459 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:23.340463 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:23.340500 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.340572 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.340593 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:09:23.340937 28440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.336194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37005 (local address 127.25.227.1:50441)
0811 11:09:23.336417 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.336453 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.336937 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.337156 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.337159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.337218 (+ 59us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:23.337779 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.337785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.338477 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.338478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.339266 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.339269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.339676 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.339677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.339794 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.340305 (+ 511us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:23.340306 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:23.340334 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:23.340357 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:23.340509 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:23.340512 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:23.340515 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.340562 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.340684 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":115,"threads_started":1}
I20260811 11:09:23.341039 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28209
I20260811 11:09:23.341151 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:09:23.341420 26508 external_mini_cluster.cc:1428] Setting key 5653a754341e447c949de431f06d84e7
I20260811 11:09:23.341625 28436 heartbeater.cc:347] Connected to a master server at 127.25.227.62:37005
I20260811 11:09:23.341737 28436 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:23.341934 28436 heartbeater.cc:511] Master 127.25.227.62:37005 requested a full tablet report, sending...
I20260811 11:09:23.342415 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37005
--builtin_ntp_servers=127.25.227.20:43555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:09:23.342442 28101 ts_manager.cc:194] Registered new tserver with Master: d7456f21d330412fba1bc6e91ea15787 (127.25.227.1:42937)
I20260811 11:09:23.343103 28101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.1:50441
W20260811 11:09:23.427564 28442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:23.427783 28442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:23.427806 28442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:23.428954 28442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:23.428995 28442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:23.429041 28442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:23.430397 28442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:23.430647 28442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:23.430946 28442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:23.435974 28453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.435966 28449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.435966 28450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:23.436215 28442 server_base.cc:1034] running on GCE node
I20260811 11:09:23.436446 28442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:23.436653 28442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:23.437798 28442 hybrid_clock.cc:648] HybridClock initialized: now 1786446563437788 us; error 40 us; skew 500 ppm
I20260811 11:09:23.439096 28442 webserver.cc:460] Webserver started at http://127.25.227.2:46709/ using document root <none> and password file <none>
I20260811 11:09:23.439370 28442 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:23.439441 28442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:23.439600 28442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:23.440696 28442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "13b7b273a6394fbe85981727d042a646"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "72cf40328518e76d0fa51ca3abebfc1c"
server_key_iv: "478587b910ed057d4895dfdca4776154"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.441054 28442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "13b7b273a6394fbe85981727d042a646"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "72cf40328518e76d0fa51ca3abebfc1c"
server_key_iv: "478587b910ed057d4895dfdca4776154"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.442457 28442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:23.443153 28460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.443346 28442 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:23.443442 28442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "13b7b273a6394fbe85981727d042a646"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "72cf40328518e76d0fa51ca3abebfc1c"
server_key_iv: "478587b910ed057d4895dfdca4776154"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.443519 28442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:23.467223 28442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:23.467581 28442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:23.467732 28442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:23.467967 28442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:23.468386 28442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:23.468451 28442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.468497 28442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:23.468523 28442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.474267 28442 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:45315
I20260811 11:09:23.474346 28673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:45315 every 8 connection(s)
I20260811 11:09:23.474761 28442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:09:23.478368 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28442
I20260811 11:09:23.478456 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:09:23.478662 26508 external_mini_cluster.cc:1428] Setting key 58e56a18af32cd47258f368981c1d636
I20260811 11:09:23.479700 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37005
--builtin_ntp_servers=127.25.227.20:43555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:09:23.480427 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.475510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:51181 (local address 127.25.227.62:37005)
0811 11:09:23.475567 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.475570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.475850 (+ 280us) server_negotiation.cc:407] Connection header received
0811 11:09:23.476372 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.476374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.476386 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.476441 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:23.477205 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.477708 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.478825 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.479086 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.479160 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.480171 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:23.480172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:23.480172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:23.480177 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:23.480193 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:23.480198 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:23.480249 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.480346 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.480367 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:09:23.480731 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.475492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37005 (local address 127.25.227.2:51181)
0811 11:09:23.475707 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.475761 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.476268 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.476512 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.476516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.476526 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:23.477063 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.477068 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.477807 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.477808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.478675 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.478677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.479170 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.479171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.479317 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.480009 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:23.480009 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:23.480047 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:23.480074 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:23.480264 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:23.480270 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:23.480273 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.480351 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.480467 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260811 11:09:23.481257 28674 heartbeater.cc:347] Connected to a master server at 127.25.227.62:37005
I20260811 11:09:23.481359 28674 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:23.481571 28674 heartbeater.cc:511] Master 127.25.227.62:37005 requested a full tablet report, sending...
I20260811 11:09:23.481953 28101 ts_manager.cc:194] Registered new tserver with Master: 13b7b273a6394fbe85981727d042a646 (127.25.227.2:45315)
I20260811 11:09:23.482465 28101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.2:51181
W20260811 11:09:23.564380 28677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:23.564611 28677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:23.564649 28677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:23.565860 28677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:23.565914 28677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:23.565954 28677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:23.567286 28677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:43555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:37005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:23.567543 28677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:23.567857 28677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:23.573028 28689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.573024 28685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:23.573025 28686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:23.573060 28677 server_base.cc:1034] running on GCE node
I20260811 11:09:23.573568 28677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:23.573817 28677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:23.574973 28677 hybrid_clock.cc:648] HybridClock initialized: now 1786446563574956 us; error 30 us; skew 500 ppm
I20260811 11:09:23.576243 28677 webserver.cc:460] Webserver started at http://127.25.227.3:36345/ using document root <none> and password file <none>
I20260811 11:09:23.576505 28677 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:23.576572 28677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:23.576721 28677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:23.577814 28677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "c3eedfa568064a9b9a089ff3b3e9b274"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "0a4fbdc22f911e72ab8a386d1e8053c2"
server_key_iv: "2e68842fc27aef7ec417d8b207f14310"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.578172 28677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "c3eedfa568064a9b9a089ff3b3e9b274"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "0a4fbdc22f911e72ab8a386d1e8053c2"
server_key_iv: "2e68842fc27aef7ec417d8b207f14310"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.579459 28677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:09:23.580289 28698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.580492 28677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:23.580595 28677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "c3eedfa568064a9b9a089ff3b3e9b274"
format_stamp: "Formatted at 2026-08-11 11:09:23 on dist-test-slave-z8x9"
server_key: "0a4fbdc22f911e72ab8a386d1e8053c2"
server_key_iv: "2e68842fc27aef7ec417d8b207f14310"
server_key_version: "encryptionkey@0"
I20260811 11:09:23.580665 28677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:23.594201 28677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:23.594482 28677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:23.594620 28677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:23.594835 28677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:23.595148 28677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:23.595199 28677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.595242 28677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:23.595269 28677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:23.601390 28677 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:35585
I20260811 11:09:23.601444 28910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:35585 every 8 connection(s)
I20260811 11:09:23.601799 28677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:09:23.606410 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 28677
I20260811 11:09:23.606523 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:09:23.606732 26508 external_mini_cluster.cc:1428] Setting key 206597e805bb345881a0124734aa79e8
I20260811 11:09:23.607266 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.602602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:48143 (local address 127.25.227.62:37005)
0811 11:09:23.602665 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.602667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.602911 (+ 244us) server_negotiation.cc:407] Connection header received
0811 11:09:23.603442 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.603444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.603457 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.603513 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:23.604230 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.604724 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.605754 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.605949 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.606024 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.606966 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:23.606968 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:23.606968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:23.606972 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:23.606987 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:23.606991 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:23.607042 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.607150 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.607176 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:09:23.607508 28920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.602566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:37005 (local address 127.25.227.3:48143)
0811 11:09:23.602778 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.602812 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.603333 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.603584 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.603588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.603598 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:23.604118 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.604123 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.604829 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.604830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.605635 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.605637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.606030 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.606032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.606172 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.606793 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:23.606794 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:23.606847 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:23.606876 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:23.607048 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:23.607054 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:23.607057 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.607151 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.607271 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":76,"threads_started":1}
I20260811 11:09:23.607952 28914 heartbeater.cc:347] Connected to a master server at 127.25.227.62:37005
I20260811 11:09:23.608033 28914 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:23.608180 28914 heartbeater.cc:511] Master 127.25.227.62:37005 requested a full tablet report, sending...
I20260811 11:09:23.608481 28101 ts_manager.cc:194] Registered new tserver with Master: c3eedfa568064a9b9a089ff3b3e9b274 (127.25.227.3:35585)
I20260811 11:09:23.608871 28101 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.3:48143
I20260811 11:09:23.618571 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:09:23.623111 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.620005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45600 (local address 127.25.227.62:37005)
0811 11:09:23.620060 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.620062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.620173 (+ 111us) server_negotiation.cc:407] Connection header received
0811 11:09:23.620241 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.620242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.620253 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.620309 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:23.620489 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.620970 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.621789 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.621996 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.622068 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.622817 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:23.622818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:23.622819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:23.622823 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:23.622838 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:23.622842 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:23.622949 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.623016 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.623027 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 11:09:23.624750 28101 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:09:23.626355 28101 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:09:23.632431 28929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.628482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:45315 (local address 127.0.0.1:48790)
0811 11:09:23.628726 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.628767 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.628837 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.629063 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.629067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.629070 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:23.629140 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.629141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.630189 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.630190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.631228 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.631231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.632141 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.632142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.632216 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.632229 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.632300 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.632353 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":71,"threads_started":1}
I20260811 11:09:23.632445 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.628587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48790 (local address 127.25.227.2:45315)
0811 11:09:23.628812 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.628818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.628853 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:09:23.628929 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.628931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.628948 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.629033 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:23.629306 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.630101 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.631338 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.632051 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.632126 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.632223 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.632320 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.632365 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":109,"threads_started":1}
I20260811 11:09:23.632778 28932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.628482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:42937 (local address 127.0.0.1:52390)
0811 11:09:23.628987 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.628997 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.629040 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.629434 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.629435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.629437 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:23.629472 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.629474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.630771 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.630772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.631649 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.631652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.632568 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.632569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.632630 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.632634 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.632664 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.632704 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":6,"thread_start_us":78,"threads_started":1}
I20260811 11:09:23.633245 28931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.628687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52390 (local address 127.25.227.1:42937)
0811 11:09:23.628884 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.628888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.629276 (+ 388us) server_negotiation.cc:407] Connection header received
0811 11:09:23.629323 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.629325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.629339 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.629547 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:23.629613 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.630668 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.631736 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.632465 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.632965 (+ 500us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.633054 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.633078 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.633125 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260811 11:09:23.633268 28928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.628689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:35585 (local address 127.0.0.1:59724)
0811 11:09:23.629108 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.629116 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.629157 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.629403 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.629404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.629406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:23.629455 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.629456 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.630725 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.630726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.631807 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.631810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.633018 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.633019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.633080 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.633085 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.633133 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.633198 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":25,"thread_start_us":76,"threads_started":1}
I20260811 11:09:23.633481 28934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.628921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59724 (local address 127.25.227.3:35585)
0811 11:09:23.629112 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.629115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.629154 (+ 39us) server_negotiation.cc:407] Connection header received
0811 11:09:23.629241 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.629243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.629260 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.629337 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:23.629533 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.630631 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.631899 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.632828 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.632900 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.632982 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.633362 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.633406 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260811 11:09:23.633380 28552 tablet_service.cc:1467] Processing CreateTablet for tablet d52a34f86bdf4e78817c9b381e94c492 (DEFAULT_TABLE table=test-table [id=b894986069fd4936bed3d40819162aeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:23.633795 28552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d52a34f86bdf4e78817c9b381e94c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:23.633951 28318 tablet_service.cc:1467] Processing CreateTablet for tablet d52a34f86bdf4e78817c9b381e94c492 (DEFAULT_TABLE table=test-table [id=b894986069fd4936bed3d40819162aeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:23.634269 28318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d52a34f86bdf4e78817c9b381e94c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:23.637343 28935 tablet_bootstrap.cc:492] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Bootstrap starting.
I20260811 11:09:23.637519 28936 tablet_bootstrap.cc:492] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: Bootstrap starting.
I20260811 11:09:23.638096 28935 tablet_bootstrap.cc:654] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:23.638121 28936 tablet_bootstrap.cc:654] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:23.638049 28788 tablet_service.cc:1467] Processing CreateTablet for tablet d52a34f86bdf4e78817c9b381e94c492 (DEFAULT_TABLE table=test-table [id=b894986069fd4936bed3d40819162aeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:23.638361 28788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d52a34f86bdf4e78817c9b381e94c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:23.638453 28936 log.cc:824] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:23.638453 28935 log.cc:824] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:23.639240 28935 tablet_bootstrap.cc:492] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: No bootstrap required, opened a new log
I20260811 11:09:23.639315 28935 ts_tablet_manager.cc:1397] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:23.639456 28936 tablet_bootstrap.cc:492] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: No bootstrap required, opened a new log
I20260811 11:09:23.639521 28936 ts_tablet_manager.cc:1397] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:23.641366 28941 tablet_bootstrap.cc:492] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Bootstrap starting.
I20260811 11:09:23.641960 28941 tablet_bootstrap.cc:654] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:23.642103 28935 raft_consensus.cc:348] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.642256 28941 log.cc:824] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:23.642282 28935 raft_consensus.cc:374] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:23.642187 28936 raft_consensus.cc:348] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.642324 28936 raft_consensus.cc:374] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:23.642321 28935 raft_consensus.cc:729] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13b7b273a6394fbe85981727d042a646, State: Initialized, Role: FOLLOWER
I20260811 11:09:23.642365 28936 raft_consensus.cc:729] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7456f21d330412fba1bc6e91ea15787, State: Initialized, Role: FOLLOWER
I20260811 11:09:23.642469 28935 consensus_queue.cc:260] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.642472 28936 consensus_queue.cc:260] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.642731 28935 ts_tablet_manager.cc:1428] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 11:09:23.642726 28936 ts_tablet_manager.cc:1428] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:09:23.642865 28674 heartbeater.cc:503] Master 127.25.227.62:37005 was elected leader, sending a full tablet report...
I20260811 11:09:23.643121 28436 heartbeater.cc:503] Master 127.25.227.62:37005 was elected leader, sending a full tablet report...
I20260811 11:09:23.643239 28941 tablet_bootstrap.cc:492] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: No bootstrap required, opened a new log
I20260811 11:09:23.643293 28941 ts_tablet_manager.cc:1397] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:23.645404 28941 raft_consensus.cc:348] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.645561 28941 raft_consensus.cc:374] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:23.645596 28941 raft_consensus.cc:729] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3eedfa568064a9b9a089ff3b3e9b274, State: Initialized, Role: FOLLOWER
I20260811 11:09:23.645677 28941 consensus_queue.cc:260] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.645884 28941 ts_tablet_manager.cc:1428] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 11:09:23.645961 28914 heartbeater.cc:503] Master 127.25.227.62:37005 was elected leader, sending a full tablet report...
W20260811 11:09:23.725334 28675 tablet.cc:2369] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:09:23.800536 28945 raft_consensus.cc:482] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:23.800742 28945 raft_consensus.cc:504] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.801129 28945 leader_election.cc:288] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7456f21d330412fba1bc6e91ea15787 (127.25.227.1:42937), 13b7b273a6394fbe85981727d042a646 (127.25.227.2:45315)
I20260811 11:09:23.804179 28931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.801479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:34921 (local address 127.25.227.1:42937)
0811 11:09:23.801533 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.801535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.801548 (+ 13us) server_negotiation.cc:407] Connection header received
0811 11:09:23.801584 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.801585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.801600 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.801686 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:23.801906 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.802433 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.803437 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.803812 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.803870 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.803896 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.804056 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.804104 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 11:09:23.804183 28920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.801363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:42937 (local address 127.25.227.3:34921)
0811 11:09:23.801431 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.801445 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.801516 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.801729 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.801730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.801733 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:23.801818 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.801820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.802518 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.802519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.803340 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.803343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.803895 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.803896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.803969 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.803972 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.804031 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.804092 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":31}
I20260811 11:09:23.804210 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.801533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:54489 (local address 127.25.227.2:45315)
0811 11:09:23.801580 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.801582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.801697 (+ 115us) server_negotiation.cc:407] Connection header received
0811 11:09:23.801738 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.801739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.801749 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.801823 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:23.802008 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.802511 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.803475 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.803826 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.803914 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.803922 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.804094 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.804137 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 11:09:23.804203 28947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.801363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:45315 (local address 127.25.227.3:54489)
0811 11:09:23.801568 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.801578 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:23.801645 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:23.801833 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:23.801834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:23.801836 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:23.801927 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.801929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.802597 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.802598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.803360 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:23.803362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.803932 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.803933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:23.803998 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.804001 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:23.804075 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:09:23.804111 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":27,"thread_start_us":104,"threads_started":1}
I20260811 11:09:23.804571 28586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d52a34f86bdf4e78817c9b381e94c492" candidate_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13b7b273a6394fbe85981727d042a646" is_pre_election: true
I20260811 11:09:23.804615 28348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d52a34f86bdf4e78817c9b381e94c492" candidate_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7456f21d330412fba1bc6e91ea15787" is_pre_election: true
I20260811 11:09:23.804761 28586 raft_consensus.cc:2454] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3eedfa568064a9b9a089ff3b3e9b274 in term 0.
I20260811 11:09:23.804791 28348 raft_consensus.cc:2454] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3eedfa568064a9b9a089ff3b3e9b274 in term 0.
I20260811 11:09:23.805038 28708 leader_election.cc:302] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13b7b273a6394fbe85981727d042a646, c3eedfa568064a9b9a089ff3b3e9b274; no voters:
I20260811 11:09:23.805207 28945 raft_consensus.cc:2781] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:09:23.805264 28945 raft_consensus.cc:482] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:09:23.805290 28945 raft_consensus.cc:3037] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:23.806003 28945 raft_consensus.cc:504] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.806151 28945 leader_election.cc:288] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [CANDIDATE]: Term 1 election: Requested vote from peers d7456f21d330412fba1bc6e91ea15787 (127.25.227.1:42937), 13b7b273a6394fbe85981727d042a646 (127.25.227.2:45315)
I20260811 11:09:23.806308 28586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d52a34f86bdf4e78817c9b381e94c492" candidate_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13b7b273a6394fbe85981727d042a646"
I20260811 11:09:23.806394 28586 raft_consensus.cc:3037] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:23.807245 28586 raft_consensus.cc:2454] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3eedfa568064a9b9a089ff3b3e9b274 in term 1.
I20260811 11:09:23.807374 28348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d52a34f86bdf4e78817c9b381e94c492" candidate_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7456f21d330412fba1bc6e91ea15787"
I20260811 11:09:23.807427 28708 leader_election.cc:302] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13b7b273a6394fbe85981727d042a646, c3eedfa568064a9b9a089ff3b3e9b274; no voters:
I20260811 11:09:23.807461 28348 raft_consensus.cc:3037] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:23.807546 28945 raft_consensus.cc:2781] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:23.807723 28945 raft_consensus.cc:686] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 1 LEADER]: Becoming Leader. State: Replica: c3eedfa568064a9b9a089ff3b3e9b274, State: Running, Role: LEADER
I20260811 11:09:23.807845 28945 consensus_queue.cc:237] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } }
I20260811 11:09:23.808458 28348 raft_consensus.cc:2454] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3eedfa568064a9b9a089ff3b3e9b274 in term 1.
I20260811 11:09:23.808921 28101 catalog_manager.cc:5495] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3eedfa568064a9b9a089ff3b3e9b274 (127.25.227.3). New cstate: current_term: 1 leader_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3eedfa568064a9b9a089ff3b3e9b274" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 35585 } health_report { overall_health: HEALTHY } } }
W20260811 11:09:23.836117 28438 tablet.cc:2369] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 11:09:23.852409 28918 tablet.cc:2369] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:09:23.858461 28934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.856007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59740 (local address 127.25.227.3:35585)
0811 11:09:23.856071 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:23.856074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:23.856086 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:09:23.856159 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:23.856161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:23.856181 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:23.856257 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:23.856413 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.856886 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.857697 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:23.857896 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:23.857969 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:23.858111 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:23.858211 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:23.858321 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:23.858353 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 11:09:23.858361 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:09:23.860198 28348 raft_consensus.cc:1261] T d52a34f86bdf4e78817c9b381e94c492 P d7456f21d330412fba1bc6e91ea15787 [term 1 FOLLOWER]: Refusing update from remote peer c3eedfa568064a9b9a089ff3b3e9b274: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:23.860206 28586 raft_consensus.cc:1261] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 1 FOLLOWER]: Refusing update from remote peer c3eedfa568064a9b9a089ff3b3e9b274: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:23.860591 28948 consensus_queue.cc:1035] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13b7b273a6394fbe85981727d042a646" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 45315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:23.860719 28945 consensus_queue.cc:1035] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7456f21d330412fba1bc6e91ea15787" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 42937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:23.863423 28953 mvcc.cc:205] Tried to move back new op lower bound from 7317285125568720896 to 7317285125357711360. Current Snapshot: MvccSnapshot[applied={T|T < 7317285125568720896}]
I20260811 11:09:23.863996 28954 mvcc.cc:205] Tried to move back new op lower bound from 7317285125568720896 to 7317285125357711360. Current Snapshot: MvccSnapshot[applied={T|T < 7317285125568720896}]
I20260811 11:09:23.865937 28098 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:23.866027 28098 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:23.866806 28098 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe8bde36f3ac41cabf53846c712b5e1d: Sending DeleteTablet for 3 replicas of tablet d52a34f86bdf4e78817c9b381e94c492
I20260811 11:09:23.867180 28552 tablet_service.cc:1514] Processing DeleteTablet for tablet d52a34f86bdf4e78817c9b381e94c492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:23 UTC) from {username='slave'} at 127.0.0.1:48790
I20260811 11:09:23.867221 28318 tablet_service.cc:1514] Processing DeleteTablet for tablet d52a34f86bdf4e78817c9b381e94c492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:23 UTC) from {username='slave'} at 127.0.0.1:52390
I20260811 11:09:23.867426 28788 tablet_service.cc:1514] Processing DeleteTablet for tablet d52a34f86bdf4e78817c9b381e94c492 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:23 UTC) from {username='slave'} at 127.0.0.1:59724
I20260811 11:09:23.867498 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28209
I20260811 11:09:23.870570 28967 tablet_replica.cc:330] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: stopping tablet replica
I20260811 11:09:23.870571 28966 tablet_replica.cc:330] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: stopping tablet replica
I20260811 11:09:23.870671 28967 raft_consensus.cc:2229] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:09:23.870671 28966 raft_consensus.cc:2229] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:23.870754 28967 raft_consensus.cc:2258] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:23.870774 28966 raft_consensus.cc:2258] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:23.875651 28966 ts_tablet_manager.cc:1905] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:23.875653 28967 ts_tablet_manager.cc:1905] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:23.877343 28967 ts_tablet_manager.cc:1918] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:23.877333 28966 ts_tablet_manager.cc:1918] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:23.877410 28966 log.cc:1196] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/d52a34f86bdf4e78817c9b381e94c492
I20260811 11:09:23.877410 28967 log.cc:1196] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/d52a34f86bdf4e78817c9b381e94c492
I20260811 11:09:23.877679 28966 ts_tablet_manager.cc:1939] T d52a34f86bdf4e78817c9b381e94c492 P 13b7b273a6394fbe85981727d042a646: Deleting consensus metadata
I20260811 11:09:23.877679 28967 ts_tablet_manager.cc:1939] T d52a34f86bdf4e78817c9b381e94c492 P c3eedfa568064a9b9a089ff3b3e9b274: Deleting consensus metadata
I20260811 11:09:23.878274 28077 catalog_manager.cc:4841] TS 13b7b273a6394fbe85981727d042a646 (127.25.227.2:45315): tablet d52a34f86bdf4e78817c9b381e94c492 (table test-table [id=b894986069fd4936bed3d40819162aeb]) successfully deleted
I20260811 11:09:23.878367 28077 catalog_manager.cc:4841] TS c3eedfa568064a9b9a089ff3b3e9b274 (127.25.227.3:35585): tablet d52a34f86bdf4e78817c9b381e94c492 (table test-table [id=b894986069fd4936bed3d40819162aeb]) successfully deleted
W20260811 11:09:23.888907 28074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:42937 (error 108)
I20260811 11:09:23.889513 28929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:23.889356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:42937 (local address 127.0.0.1:52406)
0811 11:09:23.889420 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:23.889467 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:42937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:09:23.889611 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28442
W20260811 11:09:23.895706 28074 catalog_manager.cc:4584] TS d7456f21d330412fba1bc6e91ea15787 (127.25.227.1:42937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d52a34f86bdf4e78817c9b381e94c492: Network error: Client connection negotiation failed: client connection to 127.25.227.1:42937: connect: Connection refused (error 111)
I20260811 11:09:23.904512 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28677
I20260811 11:09:23.922313 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 28045
2026-08-11T11:09:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (928 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:23 dist-test-slave-z8x9 krb5kdc[28972](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:23 dist-test-slave-z8x9 krb5kdc[28972](info): set up 2 sockets
Aug 11 11:09:23 dist-test-slave-z8x9 krb5kdc[28972](info): commencing operation
krb5kdc: starting...
W20260811 11:09:25.233372 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:25.358587 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46785
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:46785
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:25.446422 29002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:25.446640 29002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:25.446662 29002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:25.447736 29002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:25.447772 29002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:25.447786 29002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:25.447798 29002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:25.447810 29002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:25.449302 29002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:46785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:46785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:25.449499 29002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:25.449671 29002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:25.454557 29011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:25.454582 29013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:25.454614 29010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.454756 29002 server_base.cc:1034] running on GCE node
I20260811 11:09:25.455019 29002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:25.455269 29002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:25.456444 29002 hybrid_clock.cc:648] HybridClock initialized: now 1786446565456431 us; error 30 us; skew 500 ppm
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:25.459055 29002 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:25.459556 29002 webserver.cc:460] Webserver started at http://127.25.227.62:34053/ using document root <none> and password file <none>
I20260811 11:09:25.459787 29002 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:25.459857 29002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:25.460016 29002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:25.461135 29002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "fcf0e5859900421097a03142bb7d7208"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "a56c41a588025dac49058200ec6b213d"
server_key_iv: "49e9a5c99515b2368fed456186328629"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.461585 29002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "fcf0e5859900421097a03142bb7d7208"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "a56c41a588025dac49058200ec6b213d"
server_key_iv: "49e9a5c99515b2368fed456186328629"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.462989 29002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:09:25.463717 29027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.463891 29002 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:25.463995 29002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "fcf0e5859900421097a03142bb7d7208"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "a56c41a588025dac49058200ec6b213d"
server_key_iv: "49e9a5c99515b2368fed456186328629"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.464078 29002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:25.473883 29002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:25.475845 29002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:25.476008 29002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:25.480192 29002 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:46785
I20260811 11:09:25.480224 29116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:46785 every 8 connection(s)
I20260811 11:09:25.480587 29002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:25.481531 29117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:25.483803 29117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208: Bootstrap starting.
I20260811 11:09:25.484465 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29002
I20260811 11:09:25.484498 29117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:25.484607 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:25.484831 26508 external_mini_cluster.cc:1428] Setting key 8f466b8fa2287786632fa82ac6410b17
I20260811 11:09:25.484846 29117 log.cc:824] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:25.485728 29117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208: No bootstrap required, opened a new log
I20260811 11:09:25.488129 29117 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf0e5859900421097a03142bb7d7208" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46785 } }
I20260811 11:09:25.488302 29117 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:25.488341 29117 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcf0e5859900421097a03142bb7d7208, State: Initialized, Role: FOLLOWER
I20260811 11:09:25.488463 29117 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf0e5859900421097a03142bb7d7208" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46785 } }
I20260811 11:09:25.488540 29117 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:25.488570 29117 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:25.488612 29117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:25.489311 29117 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf0e5859900421097a03142bb7d7208" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46785 } }
I20260811 11:09:25.489403 29117 leader_election.cc:302] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcf0e5859900421097a03142bb7d7208; no voters:
I20260811 11:09:25.489624 29117 leader_election.cc:288] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:25.489667 29124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:25.489893 29124 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [term 1 LEADER]: Becoming Leader. State: Replica: fcf0e5859900421097a03142bb7d7208, State: Running, Role: LEADER
I20260811 11:09:25.489923 29117 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:25.490025 29124 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf0e5859900421097a03142bb7d7208" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46785 } }
I20260811 11:09:25.490386 29127 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcf0e5859900421097a03142bb7d7208" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf0e5859900421097a03142bb7d7208" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46785 } } }
I20260811 11:09:25.490377 29124 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcf0e5859900421097a03142bb7d7208. Latest consensus state: current_term: 1 leader_uuid: "fcf0e5859900421097a03142bb7d7208" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcf0e5859900421097a03142bb7d7208" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 46785 } } }
I20260811 11:09:25.490550 29127 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:25.490564 29124 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:25.490952 29142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:25.491500 29142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:25.493397 29142 catalog_manager.cc:1347] Generated new cluster ID: ad08189f00e6464ca7cca7b9b4ea4eb3
I20260811 11:09:25.493454 29142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:25.496513 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:25.485375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49276 (local address 127.25.227.62:46785)
0811 11:09:25.485529 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:25.485539 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:25.485594 (+ 55us) server_negotiation.cc:407] Connection header received
0811 11:09:25.486075 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:25.486083 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:25.486133 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:25.486262 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:25.487050 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.487918 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.488986 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.489526 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.489649 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:25.492654 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:25.492658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:25.492659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:25.492671 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:25.494800 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:25.495198 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:25.495201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:25.495201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:25.495325 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:25.495533 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:25.495534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:25.495534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:25.495861 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:25.496023 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:25.496137 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 11:09:25.496294 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260811 11:09:25.510128 29142 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:25.510872 29142 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:25.521730 29142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208: Generated new TSK 0
I20260811 11:09:25.521960 29142 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.25.227.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
Entry for principal kudu/127.25.227.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab.
I20260811 11:09:25.553854 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46785
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:25.637240 29161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:25.637463 29161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:25.637501 29161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:25.638613 29161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:25.638684 29161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:25.638731 29161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:25.640173 29161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.1.keytab
--principal=kudu/127.25.227.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:25.640426 29161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:25.640664 29161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:25.645709 29172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:25.645773 29169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.645892 29161 server_base.cc:1034] running on GCE node
W20260811 11:09:25.645718 29168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.646210 29161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:25.646476 29161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:25.647644 29161 hybrid_clock.cc:648] HybridClock initialized: now 1786446565647643 us; error 40 us; skew 500 ppm
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:25.650259 29161 init.cc:377] Logged in from keytab as kudu/127.25.227.1@KRBTEST.COM (short username kudu)
I20260811 11:09:25.650682 29161 webserver.cc:460] Webserver started at http://127.25.227.1:41343/ using document root <none> and password file <none>
I20260811 11:09:25.650949 29161 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:25.651021 29161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:25.651171 29161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:25.652182 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "7dbbe1090e2f4f6d998834e2b582641e"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "fc6f4f96acb19a13a1ec0652fa2a8651"
server_key_iv: "eb914524a72db3efb95697f2d00d03a9"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.652560 29161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "7dbbe1090e2f4f6d998834e2b582641e"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "fc6f4f96acb19a13a1ec0652fa2a8651"
server_key_iv: "eb914524a72db3efb95697f2d00d03a9"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.653992 29161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:25.654726 29180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.654915 29161 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:25.655015 29161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "7dbbe1090e2f4f6d998834e2b582641e"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "fc6f4f96acb19a13a1ec0652fa2a8651"
server_key_iv: "eb914524a72db3efb95697f2d00d03a9"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.655094 29161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:25.674685 29161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:25.676616 29161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:25.676800 29161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:25.677053 29161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:25.677438 29161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:25.677496 29161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.677541 29161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:25.677589 29161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.683562 29161 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:40605
I20260811 11:09:25.683619 29363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:40605 every 8 connection(s)
I20260811 11:09:25.683943 29161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.1@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:25.690030 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29161
I20260811 11:09:25.690153 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:09:25.690374 26508 external_mini_cluster.cc:1428] Setting key d64565bc869bb0398bc62c78d000ac7b
I20260811 11:09:25.693625 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:25.684748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:40147 (local address 127.25.227.62:46785)
0811 11:09:25.684809 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:25.684812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:25.685008 (+ 196us) server_negotiation.cc:407] Connection header received
0811 11:09:25.685496 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:25.685497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:25.685507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:25.685565 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:25.686515 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.687013 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.687955 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.688157 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.688207 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:25.690443 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:25.690445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:25.690445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:25.690453 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:25.692197 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:25.692590 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:25.692592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:25.692592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:25.692660 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:25.692909 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:25.692910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:25.692911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:25.693058 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:25.693134 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:25.693486 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 11:09:25.693559 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 11:09:25.693926 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:25.684711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46785 (local address 127.25.227.1:40147)
0811 11:09:25.684875 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:25.684920 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:25.685417 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:25.685617 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:25.685620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:25.686203 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:25.686435 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:25.686440 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.687097 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.687098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:25.687883 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:25.687885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.688231 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.688231 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:25.688334 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:25.688793 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:25.688802 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:25.690347 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:25.692282 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:25.692289 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:25.692291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:25.692514 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:25.692729 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:25.692730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:25.692730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:25.692844 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:25.693132 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:25.693139 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:25.693336 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 11:09:25.693460 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 11:09:25.693644 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260811 11:09:25.694558 29365 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46785
I20260811 11:09:25.694667 29365 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:25.694881 29365 heartbeater.cc:511] Master 127.25.227.62:46785 requested a full tablet report, sending...
I20260811 11:09:25.695403 29059 ts_manager.cc:194] Registered new tserver with Master: 7dbbe1090e2f4f6d998834e2b582641e (127.25.227.1:40605)
I20260811 11:09:25.696004 29059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.1@KRBTEST.COM'} at 127.25.227.1:40147
WARNING: no policy specified for kudu/127.25.227.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
Entry for principal kudu/127.25.227.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab.
I20260811 11:09:25.715975 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46785
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:25.799032 29373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:25.799252 29373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:25.799276 29373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:25.800429 29373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:25.800470 29373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:25.800496 29373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:25.801915 29373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.2.keytab
--principal=kudu/127.25.227.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:25.802095 29373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:25.802276 29373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:25.807693 29395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:25.807744 29387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.807864 29373 server_base.cc:1034] running on GCE node
W20260811 11:09:25.807708 29386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.808125 29373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:25.808391 29373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:25.809588 29373 hybrid_clock.cc:648] HybridClock initialized: now 1786446565809568 us; error 31 us; skew 500 ppm
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:25.812186 29373 init.cc:377] Logged in from keytab as kudu/127.25.227.2@KRBTEST.COM (short username kudu)
I20260811 11:09:25.812678 29373 webserver.cc:460] Webserver started at http://127.25.227.2:38711/ using document root <none> and password file <none>
I20260811 11:09:25.812908 29373 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:25.812978 29373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:25.813241 29373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:25.814296 29373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "497eb7f0776d4b3c97b46a0d81a35acb"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "6c871b0081a7f41462aba567b0fca306"
server_key_iv: "509fbb1bc232a2b9a58cd8b7911e0c57"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.814666 29373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "497eb7f0776d4b3c97b46a0d81a35acb"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "6c871b0081a7f41462aba567b0fca306"
server_key_iv: "509fbb1bc232a2b9a58cd8b7911e0c57"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.816025 29373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:25.816808 29407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.816998 29373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:25.817106 29373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "497eb7f0776d4b3c97b46a0d81a35acb"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "6c871b0081a7f41462aba567b0fca306"
server_key_iv: "509fbb1bc232a2b9a58cd8b7911e0c57"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.817262 29373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:25.825052 29373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:25.826910 29373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:25.827080 29373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:25.827317 29373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:25.827653 29373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:25.827710 29373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.827746 29373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:25.827773 29373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.834082 29373 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:34565
I20260811 11:09:25.834138 29588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:34565 every 8 connection(s)
I20260811 11:09:25.834440 29373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.2@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:25.841051 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29373
I20260811 11:09:25.841209 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:09:25.841425 26508 external_mini_cluster.cc:1428] Setting key 46ad312aab8dde3e48818f4d9ad6892c
I20260811 11:09:25.843806 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:25.835203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:49463 (local address 127.25.227.62:46785)
0811 11:09:25.835281 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:25.835283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:25.835455 (+ 172us) server_negotiation.cc:407] Connection header received
0811 11:09:25.835936 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:25.835938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:25.835947 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:25.836004 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:25.836900 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.837487 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.838428 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.838607 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.838658 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:25.840736 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:25.840738 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:25.840739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:25.840753 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:25.842440 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:25.842855 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:25.842856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:25.842857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:25.842919 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:25.843170 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:25.843171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:25.843171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:25.843284 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:25.843358 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:25.843633 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 11:09:25.843715 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 11:09:25.843997 29594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:25.835164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46785 (local address 127.25.227.2:49463)
0811 11:09:25.835321 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:25.835360 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:25.835852 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:25.836055 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:25.836058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:25.836628 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:25.836823 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:25.836828 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.837572 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.837573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:25.838353 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:25.838355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:25.838677 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:25.838678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:25.838776 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:25.839245 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:25.839253 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:25.840631 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:25.842522 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:25.842529 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:25.842531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:25.842748 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:25.842985 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:25.842986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:25.842986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:25.843093 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:25.843362 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:25.843369 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:25.843494 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 11:09:25.843596 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 11:09:25.843749 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260811 11:09:25.844513 29591 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46785
I20260811 11:09:25.844630 29591 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:25.844830 29591 heartbeater.cc:511] Master 127.25.227.62:46785 requested a full tablet report, sending...
I20260811 11:09:25.845221 29059 ts_manager.cc:194] Registered new tserver with Master: 497eb7f0776d4b3c97b46a0d81a35acb (127.25.227.2:34565)
I20260811 11:09:25.845613 29059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.2@KRBTEST.COM'} at 127.25.227.2:49463
WARNING: no policy specified for kudu/127.25.227.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
Entry for principal kudu/127.25.227.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab.
I20260811 11:09:25.867529 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46785
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:25.951186 29599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:25.951431 29599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:25.951472 29599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:25.952682 29599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:25.952749 29599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:25.952795 29599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:25.954397 29599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.3.keytab
--principal=kudu/127.25.227.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:46785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:25.954670 29599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:25.954933 29599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:25.960266 29607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:25.960266 29609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.960318 29599 server_base.cc:1034] running on GCE node
W20260811 11:09:25.960317 29611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:25.960762 29599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:25.961026 29599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:25.962167 29599 hybrid_clock.cc:648] HybridClock initialized: now 1786446565962157 us; error 30 us; skew 500 ppm
Aug 11 11:09:25 dist-test-slave-z8x9 krb5kdc[28972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:25.964735 29599 init.cc:377] Logged in from keytab as kudu/127.25.227.3@KRBTEST.COM (short username kudu)
I20260811 11:09:25.965219 29599 webserver.cc:460] Webserver started at http://127.25.227.3:45881/ using document root <none> and password file <none>
I20260811 11:09:25.965451 29599 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:25.965493 29599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:25.965585 29599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:25.966616 29599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "d0f2d87f4b2942a99a8289a1bc400e39"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "63c7959f8e978ea376b7fe1bf3729f70"
server_key_iv: "4d786707948472ff595d558f6e089937"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.966930 29599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "d0f2d87f4b2942a99a8289a1bc400e39"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "63c7959f8e978ea376b7fe1bf3729f70"
server_key_iv: "4d786707948472ff595d558f6e089937"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.968319 29599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:25.968984 29624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.969208 29599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:25.969321 29599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "d0f2d87f4b2942a99a8289a1bc400e39"
format_stamp: "Formatted at 2026-08-11 11:09:25 on dist-test-slave-z8x9"
server_key: "63c7959f8e978ea376b7fe1bf3729f70"
server_key_iv: "4d786707948472ff595d558f6e089937"
server_key_version: "encryptionkey@0"
I20260811 11:09:25.969395 29599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:25.986696 29599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:25.988545 29599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:25.988706 29599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:25.988950 29599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:25.989359 29599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:25.989400 29599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.989441 29599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:25.989466 29599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:25.998875 29599 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:38721
I20260811 11:09:25.998956 29832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:38721 every 8 connection(s)
I20260811 11:09:25.999316 29599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:09:26.003415 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29599
I20260811 11:09:26.003542 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:09:26.003724 26508 external_mini_cluster.cc:1428] Setting key 49edbfb5a4bda4895c9dd431d958b55a
Aug 11 11:09:26 dist-test-slave-z8x9 krb5kdc[28972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446565, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.3@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:26.009042 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.000184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:34673 (local address 127.25.227.62:46785)
0811 11:09:26.000271 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.000273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.000481 (+ 208us) server_negotiation.cc:407] Connection header received
0811 11:09:26.000964 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.000965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.000976 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.001032 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.002005 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.002513 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.003496 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.003799 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.003877 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.006337 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.006338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.006339 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:26.006347 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.007612 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:26.008048 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:26.008050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:26.008050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:26.008116 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:26.008385 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:26.008386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:26.008387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:26.008503 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.008579 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.008864 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.008949 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 11:09:26.009255 29835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.000136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:46785 (local address 127.25.227.3:34673)
0811 11:09:26.000353 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.000395 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.000881 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.001096 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.001100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.001708 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:26.001927 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.001932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.002595 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.002595 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.003408 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.003410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.003900 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.003901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.004058 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.004730 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:26.004756 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:26.006239 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:26.007712 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:26.007719 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:26.007721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:26.007968 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:26.008188 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:26.008189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:26.008190 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:26.008309 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:26.008570 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:26.008578 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:26.008721 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.008840 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.009000 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":110,"threads_started":1}
I20260811 11:09:26.009881 29833 heartbeater.cc:347] Connected to a master server at 127.25.227.62:46785
I20260811 11:09:26.009984 29833 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:26.010135 29833 heartbeater.cc:511] Master 127.25.227.62:46785 requested a full tablet report, sending...
I20260811 11:09:26.010489 29059 ts_manager.cc:194] Registered new tserver with Master: d0f2d87f4b2942a99a8289a1bc400e39 (127.25.227.3:38721)
I20260811 11:09:26.010828 29059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.25.227.3@KRBTEST.COM'} at 127.25.227.3:34673
I20260811 11:09:26.015501 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:09:26.023015 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.016852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49286 (local address 127.25.227.62:46785)
0811 11:09:26.016922 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.016924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.016985 (+ 61us) server_negotiation.cc:407] Connection header received
0811 11:09:26.017026 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.017027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.017035 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.017087 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.017813 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.018263 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.018947 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.019123 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.019248 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.020414 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.020415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.020415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:26.020421 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.021849 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:26.022165 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:26.022166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:26.022166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:26.022219 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:26.022458 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:26.022459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:26.022459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:26.022604 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.022713 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.022836 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.022913 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 11:09:26.024700 29059 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:09:26.026345 29059 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:09:26.032794 29857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.028675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:34565 (local address 127.0.0.1:48332)
0811 11:09:26.028992 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.029004 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.029070 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.029544 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.029545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.029547 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.029637 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.029639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.030517 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.030518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.031647 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.031650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.032478 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.032479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.032576 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.032590 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.032663 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.032711 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":15,"thread_start_us":74,"threads_started":1}
I20260811 11:09:26.032863 29860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.028816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.25.227.2:34565)
0811 11:09:26.029366 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.029370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.029381 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:09:26.029417 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.029419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.029433 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.029618 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.029694 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.030408 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.031731 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.032388 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.032464 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.032520 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.032696 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.032749 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":89,"threads_started":1}
I20260811 11:09:26.033453 29858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.028675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:40605 (local address 127.0.0.1:36592)
0811 11:09:26.028863 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.028905 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.028971 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.029534 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.029538 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.029541 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.029613 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.029614 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.030981 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.030982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.031945 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.031947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.033224 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.033226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.033287 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.033292 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.033351 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.033390 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"spinlock_wait_cycles":896,"thread_start_us":110,"threads_started":1}
I20260811 11:09:26.033480 29866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.028814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36592 (local address 127.25.227.1:40605)
0811 11:09:26.029324 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.029329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.029339 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:26.029392 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.029394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.029410 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.029699 (+ 289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.029780 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.030867 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.032025 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.032772 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.033235 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.033313 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.033366 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.033402 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":94,"threads_started":1}
I20260811 11:09:26.033675 29488 tablet_service.cc:1467] Processing CreateTablet for tablet fe43da15748f4930ba9f768b988308c3 (DEFAULT_TABLE table=test-table [id=2c7b89c25e2d46cda6683fccee727870]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:26.034085 29488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe43da15748f4930ba9f768b988308c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.034426 29868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.028898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:38721 (local address 127.0.0.1:52116)
0811 11:09:26.029021 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.029032 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.029074 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.029579 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.029580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.029582 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.029710 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.029712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.032015 (+ 2303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.032015 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.032846 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.032848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.034191 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.034193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.034257 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.034261 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.034313 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.034359 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":2,"thread_start_us":84,"threads_started":1}
I20260811 11:09:26.034346 29264 tablet_service.cc:1467] Processing CreateTablet for tablet fe43da15748f4930ba9f768b988308c3 (DEFAULT_TABLE table=test-table [id=2c7b89c25e2d46cda6683fccee727870]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:26.034679 29264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe43da15748f4930ba9f768b988308c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.034725 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.029117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52116 (local address 127.25.227.3:38721)
0811 11:09:26.029329 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.029335 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.029347 (+ 12us) server_negotiation.cc:407] Connection header received
0811 11:09:26.029411 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.029413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.029431 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.029515 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.029780 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.030867 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.033097 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.034037 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.034105 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.034154 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.034584 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.034637 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":144,"threads_started":1}
I20260811 11:09:26.036818 29871 tablet_bootstrap.cc:492] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Bootstrap starting.
I20260811 11:09:26.037319 29872 tablet_bootstrap.cc:492] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: Bootstrap starting.
I20260811 11:09:26.037374 29710 tablet_service.cc:1467] Processing CreateTablet for tablet fe43da15748f4930ba9f768b988308c3 (DEFAULT_TABLE table=test-table [id=2c7b89c25e2d46cda6683fccee727870]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:26.037585 29871 tablet_bootstrap.cc:654] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.037694 29710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe43da15748f4930ba9f768b988308c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.038151 29871 log.cc:824] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.038161 29872 tablet_bootstrap.cc:654] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.038777 29872 log.cc:824] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.038944 29871 tablet_bootstrap.cc:492] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: No bootstrap required, opened a new log
I20260811 11:09:26.039038 29871 ts_tablet_manager.cc:1397] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:09:26.040613 29882 tablet_bootstrap.cc:492] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Bootstrap starting.
I20260811 11:09:26.040599 29871 raft_consensus.cc:348] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.040824 29871 raft_consensus.cc:374] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.040896 29871 raft_consensus.cc:729] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497eb7f0776d4b3c97b46a0d81a35acb, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.041015 29871 consensus_queue.cc:260] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.041320 29882 tablet_bootstrap.cc:654] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.041347 29591 heartbeater.cc:503] Master 127.25.227.62:46785 was elected leader, sending a full tablet report...
I20260811 11:09:26.041347 29871 ts_tablet_manager.cc:1428] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:09:26.041874 29882 log.cc:824] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.042263 29872 tablet_bootstrap.cc:492] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: No bootstrap required, opened a new log
I20260811 11:09:26.042331 29872 ts_tablet_manager.cc:1397] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 11:09:26.042726 29882 tablet_bootstrap.cc:492] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: No bootstrap required, opened a new log
I20260811 11:09:26.042789 29882 ts_tablet_manager.cc:1397] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:09:26.043860 29872 raft_consensus.cc:348] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.044047 29872 raft_consensus.cc:374] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.044088 29872 raft_consensus.cc:729] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbe1090e2f4f6d998834e2b582641e, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.044209 29872 consensus_queue.cc:260] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.044272 29882 raft_consensus.cc:348] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.044387 29882 raft_consensus.cc:374] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.044407 29882 raft_consensus.cc:729] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2d87f4b2942a99a8289a1bc400e39, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.044492 29872 ts_tablet_manager.cc:1428] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:09:26.044528 29365 heartbeater.cc:503] Master 127.25.227.62:46785 was elected leader, sending a full tablet report...
I20260811 11:09:26.044533 29882 consensus_queue.cc:260] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.044816 29882 ts_tablet_manager.cc:1428] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 11:09:26.044834 29833 heartbeater.cc:503] Master 127.25.227.62:46785 was elected leader, sending a full tablet report...
I20260811 11:09:26.075372 29884 raft_consensus.cc:482] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:26.075484 29884 raft_consensus.cc:504] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.075775 29884 leader_election.cc:288] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbe1090e2f4f6d998834e2b582641e (127.25.227.1:40605), d0f2d87f4b2942a99a8289a1bc400e39 (127.25.227.3:38721)
I20260811 11:09:26.079226 29866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.076043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:49937 (local address 127.25.227.1:40605)
0811 11:09:26.076100 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.076102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.076111 (+ 9us) server_negotiation.cc:407] Connection header received
0811 11:09:26.076141 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.076142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.076154 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.076235 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.076419 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.076908 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.078457 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.078846 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.078909 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.078916 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.079100 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.079151 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:09:26.079243 29594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.075960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:40605 (local address 127.25.227.2:49937)
0811 11:09:26.076017 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.076030 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.076074 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.076267 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.076269 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.076271 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.076346 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.076348 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.076995 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.076996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.078363 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.078366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.078934 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.078935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.079017 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.079020 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.079075 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.079121 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":63}
I20260811 11:09:26.079298 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.076204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:59937 (local address 127.25.227.3:38721)
0811 11:09:26.076254 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.076256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.076392 (+ 136us) server_negotiation.cc:407] Connection header received
0811 11:09:26.076455 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.076456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.076466 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.076516 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.076668 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.077228 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.078528 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.078941 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.079012 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.079020 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.079182 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.079224 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 11:09:26.079512 29894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.076076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:38721 (local address 127.25.227.2:59937)
0811 11:09:26.076317 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.076326 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.076403 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.076517 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.076518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.076519 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.076595 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.076596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.077301 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.077302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.078463 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.078465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.079012 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.079013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.079096 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.079100 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.079156 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.079194 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":23,"thread_start_us":133,"threads_started":1}
I20260811 11:09:26.079670 29294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe43da15748f4930ba9f768b988308c3" candidate_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbe1090e2f4f6d998834e2b582641e" is_pre_election: true
I20260811 11:09:26.079856 29294 raft_consensus.cc:2454] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497eb7f0776d4b3c97b46a0d81a35acb in term 0.
I20260811 11:09:26.079972 29746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe43da15748f4930ba9f768b988308c3" candidate_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" is_pre_election: true
I20260811 11:09:26.080084 29413 leader_election.cc:302] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497eb7f0776d4b3c97b46a0d81a35acb, 7dbbe1090e2f4f6d998834e2b582641e; no voters:
I20260811 11:09:26.080142 29746 raft_consensus.cc:2454] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497eb7f0776d4b3c97b46a0d81a35acb in term 0.
I20260811 11:09:26.080235 29884 raft_consensus.cc:2781] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:09:26.080293 29884 raft_consensus.cc:482] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:09:26.080320 29884 raft_consensus.cc:3037] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.081050 29884 raft_consensus.cc:504] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.081212 29884 leader_election.cc:288] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbe1090e2f4f6d998834e2b582641e (127.25.227.1:40605), d0f2d87f4b2942a99a8289a1bc400e39 (127.25.227.3:38721)
I20260811 11:09:26.081344 29294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe43da15748f4930ba9f768b988308c3" candidate_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbe1090e2f4f6d998834e2b582641e"
I20260811 11:09:26.081374 29746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe43da15748f4930ba9f768b988308c3" candidate_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2d87f4b2942a99a8289a1bc400e39"
I20260811 11:09:26.081444 29294 raft_consensus.cc:3037] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.081441 29746 raft_consensus.cc:3037] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.082145 29746 raft_consensus.cc:2454] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497eb7f0776d4b3c97b46a0d81a35acb in term 1.
I20260811 11:09:26.082154 29294 raft_consensus.cc:2454] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497eb7f0776d4b3c97b46a0d81a35acb in term 1.
I20260811 11:09:26.082309 29413 leader_election.cc:302] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497eb7f0776d4b3c97b46a0d81a35acb, d0f2d87f4b2942a99a8289a1bc400e39; no voters:
I20260811 11:09:26.082454 29884 raft_consensus.cc:2781] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:26.082612 29884 raft_consensus.cc:686] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 1 LEADER]: Becoming Leader. State: Replica: 497eb7f0776d4b3c97b46a0d81a35acb, State: Running, Role: LEADER
I20260811 11:09:26.082707 29884 consensus_queue.cc:237] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } }
I20260811 11:09:26.083571 29059 catalog_manager.cc:5495] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb reported cstate change: term changed from 0 to 1, leader changed from <none> to 497eb7f0776d4b3c97b46a0d81a35acb (127.25.227.2). New cstate: current_term: 1 leader_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497eb7f0776d4b3c97b46a0d81a35acb" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 } health_report { overall_health: UNKNOWN } } }
W20260811 11:09:26.084923 29593 tablet.cc:2369] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:09:26.093509 29860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.091361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48346 (local address 127.25.227.2:34565)
0811 11:09:26.091415 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.091417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.091427 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:26.091462 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.091463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.091485 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.091548 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:26.091672 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.092122 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.092835 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.093013 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.093064 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.093234 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:26.093339 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:26.093401 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.093440 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.093457 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 11:09:26.095178 29746 raft_consensus.cc:1261] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 1 FOLLOWER]: Refusing update from remote peer 497eb7f0776d4b3c97b46a0d81a35acb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:26.095224 29294 raft_consensus.cc:1261] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 1 FOLLOWER]: Refusing update from remote peer 497eb7f0776d4b3c97b46a0d81a35acb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:26.095557 29884 consensus_queue.cc:1035] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbe1090e2f4f6d998834e2b582641e" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:26.095700 29895 consensus_queue.cc:1035] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2d87f4b2942a99a8289a1bc400e39" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 38721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:26.098301 29901 mvcc.cc:205] Tried to move back new op lower bound from 7317285134723371008 to 7317285134675611648. Current Snapshot: MvccSnapshot[applied={T|T < 7317285134723371008}]
I20260811 11:09:26.100898 29059 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:26.100991 29059 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:26.101801 29059 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fcf0e5859900421097a03142bb7d7208: Sending DeleteTablet for 3 replicas of tablet fe43da15748f4930ba9f768b988308c3
I20260811 11:09:26.102176 29264 tablet_service.cc:1514] Processing DeleteTablet for tablet fe43da15748f4930ba9f768b988308c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:26 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:36592
I20260811 11:09:26.102177 29710 tablet_service.cc:1514] Processing DeleteTablet for tablet fe43da15748f4930ba9f768b988308c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:26 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:52116
I20260811 11:09:26.102437 29922 tablet_replica.cc:330] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e: stopping tablet replica
I20260811 11:09:26.102530 29488 tablet_service.cc:1514] Processing DeleteTablet for tablet fe43da15748f4930ba9f768b988308c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:26 UTC) from {username='kudu', principal='kudu/127.25.227.62@KRBTEST.COM'} at 127.0.0.1:48332
I20260811 11:09:26.102586 29922 raft_consensus.cc:2229] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:26.102768 29922 raft_consensus.cc:2258] T fe43da15748f4930ba9f768b988308c3 P 7dbbe1090e2f4f6d998834e2b582641e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:26.102768 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29161
I20260811 11:09:26.103335 29924 tablet_replica.cc:330] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: stopping tablet replica
I20260811 11:09:26.103497 29924 raft_consensus.cc:2229] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:26.103698 29924 raft_consensus.cc:2258] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:26.109516 29924 ts_tablet_manager.cc:1905] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:26.111224 29924 ts_tablet_manager.cc:1918] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:26.111315 29924 log.cc:1196] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/fe43da15748f4930ba9f768b988308c3
I20260811 11:09:26.111588 29924 ts_tablet_manager.cc:1939] T fe43da15748f4930ba9f768b988308c3 P d0f2d87f4b2942a99a8289a1bc400e39: Deleting consensus metadata
I20260811 11:09:26.112027 29930 tablet_replica.cc:330] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: stopping tablet replica
I20260811 11:09:26.112142 29930 raft_consensus.cc:2229] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:09:26.112105 29040 catalog_manager.cc:4841] TS d0f2d87f4b2942a99a8289a1bc400e39 (127.25.227.3:38721): tablet fe43da15748f4930ba9f768b988308c3 (table test-table [id=2c7b89c25e2d46cda6683fccee727870]) successfully deleted
I20260811 11:09:26.112267 29930 raft_consensus.cc:2258] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:26.113973 29930 ts_tablet_manager.cc:1905] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:26.115805 29930 ts_tablet_manager.cc:1918] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:26.115938 29930 log.cc:1196] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/fe43da15748f4930ba9f768b988308c3
I20260811 11:09:26.116225 29930 ts_tablet_manager.cc:1939] T fe43da15748f4930ba9f768b988308c3 P 497eb7f0776d4b3c97b46a0d81a35acb: Deleting consensus metadata
I20260811 11:09:26.116683 29036 catalog_manager.cc:4841] TS 497eb7f0776d4b3c97b46a0d81a35acb (127.25.227.2:34565): tablet fe43da15748f4930ba9f768b988308c3 (table test-table [id=2c7b89c25e2d46cda6683fccee727870]) successfully deleted
W20260811 11:09:26.125231 29040 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:40605 (error 108)
I20260811 11:09:26.125509 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29373
I20260811 11:09:26.135797 29868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.125788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:40605 (local address 127.0.0.1:36598)
0811 11:09:26.135668 (+ 9880us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.135734 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:40605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9851}
W20260811 11:09:26.137696 29040 catalog_manager.cc:4584] TS 7dbbe1090e2f4f6d998834e2b582641e (127.25.227.1:40605): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fe43da15748f4930ba9f768b988308c3: Network error: Client connection negotiation failed: client connection to 127.25.227.1:40605: connect: Connection refused (error 111)
I20260811 11:09:26.142406 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29599
I20260811 11:09:26.169960 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29002
2026-08-11T11:09:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2246 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T11:09:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:26Z Disabled control of system clock
I20260811 11:09:26.208487 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45871
--webserver_interface=127.25.227.62
--webserver_port=0
--builtin_ntp_servers=127.25.227.20:36741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:45871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:26.291882 29939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:26.292117 29939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:26.292138 29939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:26.293263 29939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:26.293299 29939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:26.293311 29939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:26.293324 29939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:26.293335 29939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:26.294622 29939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:45871
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:45871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:26.294834 29939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:26.295086 29939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:26.300076 29944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:26.300166 29949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.300225 29939 server_base.cc:1034] running on GCE node
W20260811 11:09:26.300083 29946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.300669 29939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:26.300976 29939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:26.302138 29939 hybrid_clock.cc:648] HybridClock initialized: now 1786446566302114 us; error 55 us; skew 500 ppm
I20260811 11:09:26.303462 29939 webserver.cc:460] Webserver started at http://127.25.227.62:36283/ using document root <none> and password file <none>
I20260811 11:09:26.303726 29939 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:26.303818 29939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:26.303970 29939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:26.305017 29939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "b06a07f54478417fabe5fffdd3c23984"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "c4448e170f6b4cd40da39cf366d66583"
server_key_iv: "3cf903f9c46a68f84334f2f074d5310e"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.305418 29939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "b06a07f54478417fabe5fffdd3c23984"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "c4448e170f6b4cd40da39cf366d66583"
server_key_iv: "3cf903f9c46a68f84334f2f074d5310e"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.306684 29939 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:26.307382 29958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.307559 29939 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:26.307667 29939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "b06a07f54478417fabe5fffdd3c23984"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "c4448e170f6b4cd40da39cf366d66583"
server_key_iv: "3cf903f9c46a68f84334f2f074d5310e"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.307747 29939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:26.327263 29939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:26.327596 29939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:26.327765 29939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:26.331854 29939 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:45871
I20260811 11:09:26.331887 30049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:45871 every 8 connection(s)
I20260811 11:09:26.332232 29939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:26.333214 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 29939
I20260811 11:09:26.333302 30050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.333351 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:26.333550 26508 external_mini_cluster.cc:1428] Setting key ee6ea43d254166fe2789b6d94cfc4fa9
I20260811 11:09:26.336787 30050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984: Bootstrap starting.
I20260811 11:09:26.337492 30050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.337813 30050 log.cc:824] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.338593 30050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984: No bootstrap required, opened a new log
I20260811 11:09:26.339622 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.334083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42486 (local address 127.25.227.62:45871)
0811 11:09:26.334332 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.334341 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.334376 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:09:26.334901 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.334911 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.334994 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.335149 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.335340 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.336677 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.337498 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.338102 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.338201 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.338927 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.338931 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.338931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:26.339130 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.339174 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:26.339189 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.339268 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.339320 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.339401 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":104,"threads_started":1}
I20260811 11:09:26.340888 30050 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06a07f54478417fabe5fffdd3c23984" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45871 } }
I20260811 11:09:26.341019 30050 raft_consensus.cc:374] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.341042 30050 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06a07f54478417fabe5fffdd3c23984, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.341157 30050 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06a07f54478417fabe5fffdd3c23984" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45871 } }
I20260811 11:09:26.341260 30050 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:26.341285 30050 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:26.341313 30050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.341881 30050 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06a07f54478417fabe5fffdd3c23984" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45871 } }
I20260811 11:09:26.341966 30050 leader_election.cc:302] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06a07f54478417fabe5fffdd3c23984; no voters:
I20260811 11:09:26.342096 30050 leader_election.cc:288] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:26.342168 30056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:26.342335 30056 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [term 1 LEADER]: Becoming Leader. State: Replica: b06a07f54478417fabe5fffdd3c23984, State: Running, Role: LEADER
I20260811 11:09:26.342402 30050 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:26.342423 30056 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06a07f54478417fabe5fffdd3c23984" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45871 } }
I20260811 11:09:26.342785 30059 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06a07f54478417fabe5fffdd3c23984. Latest consensus state: current_term: 1 leader_uuid: "b06a07f54478417fabe5fffdd3c23984" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06a07f54478417fabe5fffdd3c23984" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45871 } } }
I20260811 11:09:26.342785 30058 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b06a07f54478417fabe5fffdd3c23984" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06a07f54478417fabe5fffdd3c23984" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 45871 } } }
I20260811 11:09:26.342900 30059 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:26.342905 30058 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:26.343132 30068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:26.343760 30068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:26.345336 30068 catalog_manager.cc:1347] Generated new cluster ID: 50d35bc997564e91ade0321aee52c3b2
I20260811 11:09:26.345413 30068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:26.352088 30068 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:26.352578 30068 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:26.359315 30068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984: Generated new TSK 0
I20260811 11:09:26.359505 30068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:26.362635 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.1:0
--local_ip_for_outbound_sockets=127.25.227.1
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45871
--builtin_ntp_servers=127.25.227.20:36741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:26.450219 30087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:26.450453 30087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:26.450490 30087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:26.451624 30087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:26.451694 30087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:26.451737 30087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.1
I20260811 11:09:26.453076 30087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.25.227.1
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.1
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:26.453385 30087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:26.453707 30087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:26.459658 30093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:26.459679 30092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.459879 30087 server_base.cc:1034] running on GCE node
W20260811 11:09:26.459913 30095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.460182 30087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:26.460465 30087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:26.461634 30087 hybrid_clock.cc:648] HybridClock initialized: now 1786446566461624 us; error 31 us; skew 500 ppm
I20260811 11:09:26.463124 30087 webserver.cc:460] Webserver started at http://127.25.227.1:38853/ using document root <none> and password file <none>
I20260811 11:09:26.463384 30087 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:26.463442 30087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:26.463588 30087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:26.465133 30087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data/instance:
uuid: "c67c5ec1a5da4149b6fd859697ccfe8b"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "0538ae3886b1fe2c894822f0eefa58d1"
server_key_iv: "b08027e1a0dec538c8509d698e30f0f8"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.465603 30087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance:
uuid: "c67c5ec1a5da4149b6fd859697ccfe8b"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "0538ae3886b1fe2c894822f0eefa58d1"
server_key_iv: "b08027e1a0dec538c8509d698e30f0f8"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.467196 30087 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:26.468027 30106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.468228 30087 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:26.468313 30087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal
uuid: "c67c5ec1a5da4149b6fd859697ccfe8b"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "0538ae3886b1fe2c894822f0eefa58d1"
server_key_iv: "b08027e1a0dec538c8509d698e30f0f8"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.468370 30087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:26.484186 30087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:26.484431 30087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:26.484539 30087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:26.484748 30087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:26.485090 30087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:26.485126 30087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.485251 30087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:26.485288 30087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.491168 30087 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.1:36023
I20260811 11:09:26.491226 30301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.1:36023 every 8 connection(s)
I20260811 11:09:26.491575 30087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/data/info.pb
I20260811 11:09:26.496611 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.492318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.1:50329 (local address 127.25.227.62:45871)
0811 11:09:26.492365 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.492367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.492642 (+ 275us) server_negotiation.cc:407] Connection header received
0811 11:09:26.493122 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.493123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.493138 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.493250 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.493917 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.494410 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.495343 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.495519 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.495568 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.496353 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.496354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.496354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:26.496358 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.496372 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:26.496376 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.496419 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.496524 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.496551 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:09:26.496819 30306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.492329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45871 (local address 127.25.227.1:50329)
0811 11:09:26.492514 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.492548 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.493030 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.493318 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.493321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.493330 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:26.493839 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.493843 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.494491 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.494492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.495269 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.495271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.495591 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.495592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.495705 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.496193 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:26.496193 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:26.496221 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:26.496264 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:26.496438 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:26.496443 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:26.496446 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.496512 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.496588 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260811 11:09:26.497406 30302 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45871
I20260811 11:09:26.497515 30302 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:26.497704 30302 heartbeater.cc:511] Master 127.25.227.62:45871 requested a full tablet report, sending...
I20260811 11:09:26.498221 29983 ts_manager.cc:194] Registered new tserver with Master: c67c5ec1a5da4149b6fd859697ccfe8b (127.25.227.1:36023)
I20260811 11:09:26.498991 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30087
I20260811 11:09:26.498983 29983 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.1:50329
I20260811 11:09:26.499101 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-0/wal/instance
I20260811 11:09:26.499320 26508 external_mini_cluster.cc:1428] Setting key 2f128412ac9bd406a36208dac4d072fb
I20260811 11:09:26.500249 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.2:0
--local_ip_for_outbound_sockets=127.25.227.2
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45871
--builtin_ntp_servers=127.25.227.20:36741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 11:09:26.584569 30307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:26.584784 30307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:26.584805 30307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:26.585999 30307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:26.586038 30307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:26.586063 30307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.2
I20260811 11:09:26.587317 30307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.25.227.2
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.2
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:26.587502 30307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:26.587755 30307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:26.593230 30319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:26.593185 30314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.593146 30307 server_base.cc:1034] running on GCE node
W20260811 11:09:26.593458 30315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.593727 30307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:26.594051 30307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:26.595283 30307 hybrid_clock.cc:648] HybridClock initialized: now 1786446566595264 us; error 26 us; skew 500 ppm
I20260811 11:09:26.596730 30307 webserver.cc:460] Webserver started at http://127.25.227.2:41191/ using document root <none> and password file <none>
I20260811 11:09:26.597010 30307 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:26.597085 30307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:26.597281 30307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:26.598426 30307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data/instance:
uuid: "b1591b78f43544e9aaba5815f3856774"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "590c64ddf5162be493e070854de5d288"
server_key_iv: "4b8282db6d9a003848ffacf84c9030d0"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.598869 30307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance:
uuid: "b1591b78f43544e9aaba5815f3856774"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "590c64ddf5162be493e070854de5d288"
server_key_iv: "4b8282db6d9a003848ffacf84c9030d0"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.600795 30307 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 11:09:26.605985 30325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.606216 30307 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.001s
I20260811 11:09:26.606323 30307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal
uuid: "b1591b78f43544e9aaba5815f3856774"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "590c64ddf5162be493e070854de5d288"
server_key_iv: "4b8282db6d9a003848ffacf84c9030d0"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.606408 30307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:26.633066 30307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:26.633471 30307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:26.633616 30307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:26.633898 30307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:26.634351 30307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:26.634418 30307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.634455 30307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:26.634485 30307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.642343 30307 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.2:40671
I20260811 11:09:26.642412 30531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.2:40671 every 8 connection(s)
I20260811 11:09:26.642889 30307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/data/info.pb
I20260811 11:09:26.649775 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.643732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:37417 (local address 127.25.227.62:45871)
0811 11:09:26.643784 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.643786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.644026 (+ 240us) server_negotiation.cc:407] Connection header received
0811 11:09:26.644586 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.644588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.644602 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.644661 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.645472 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.646065 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.647819 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.648181 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.648272 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.649424 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.649426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.649426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:26.649432 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.649453 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:26.649459 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.649527 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.649615 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.649645 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:09:26.649825 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30307
I20260811 11:09:26.649950 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal/instance
I20260811 11:09:26.650125 30537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.643691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45871 (local address 127.25.227.2:37417)
0811 11:09:26.643878 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.643924 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.644466 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.644752 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.644756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.644765 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:26.645358 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.645363 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.646203 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.646205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.647716 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.647719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.648298 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.648299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.648488 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.649223 (+ 735us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:26.649224 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:26.649290 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:26.649319 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:26.649534 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:26.649540 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:26.649544 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.649615 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.649727 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260811 11:09:26.650169 26508 external_mini_cluster.cc:1428] Setting key 73264ef7df3c01ceb9ca5aaf67cff8a2
I20260811 11:09:26.650770 30532 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45871
I20260811 11:09:26.650905 30532 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:26.651090 30532 heartbeater.cc:511] Master 127.25.227.62:45871 requested a full tablet report, sending...
I20260811 11:09:26.651280 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.25.227.3:0
--local_ip_for_outbound_sockets=127.25.227.3
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45871
--builtin_ntp_servers=127.25.227.20:36741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 11:09:26.653332 29983 ts_manager.cc:194] Registered new tserver with Master: b1591b78f43544e9aaba5815f3856774 (127.25.227.2:40671)
I20260811 11:09:26.653836 29983 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.2:37417
W20260811 11:09:26.739862 30538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:26.740079 30538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:26.740101 30538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:26.741158 30538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:26.741219 30538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:26.741245 30538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.227.3
I20260811 11:09:26.742736 30538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:36741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.25.227.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.25.227.3
--webserver_port=0
--tserver_master_addrs=127.25.227.62:45871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.25.227.3
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:26.742930 30538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:26.743254 30538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:26.748327 30548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:26.748390 30547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.748452 30538 server_base.cc:1034] running on GCE node
W20260811 11:09:26.748381 30550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:26.748888 30538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:26.749146 30538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:26.750360 30538 hybrid_clock.cc:648] HybridClock initialized: now 1786446566750343 us; error 28 us; skew 500 ppm
I20260811 11:09:26.751694 30538 webserver.cc:460] Webserver started at http://127.25.227.3:40143/ using document root <none> and password file <none>
I20260811 11:09:26.751961 30538 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:26.752034 30538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:26.752195 30538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:26.753336 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data/instance:
uuid: "e352d3a384b54e82a658a79467b22c3f"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "cfe2d5ad5e68f361c5d856e59df58314"
server_key_iv: "8727c9fcaea15ad1cbd2349341398f94"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.753712 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance:
uuid: "e352d3a384b54e82a658a79467b22c3f"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "cfe2d5ad5e68f361c5d856e59df58314"
server_key_iv: "8727c9fcaea15ad1cbd2349341398f94"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.755059 30538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:26.755769 30562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.755944 30538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:26.756047 30538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal
uuid: "e352d3a384b54e82a658a79467b22c3f"
format_stamp: "Formatted at 2026-08-11 11:09:26 on dist-test-slave-z8x9"
server_key: "cfe2d5ad5e68f361c5d856e59df58314"
server_key_iv: "8727c9fcaea15ad1cbd2349341398f94"
server_key_version: "encryptionkey@0"
I20260811 11:09:26.756120 30538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:26.794118 30538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:26.794471 30538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:26.794628 30538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:26.794906 30538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 11:09:26.795267 30538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 11:09:26.795323 30538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.795365 30538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 11:09:26.795403 30538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:26.801908 30538 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.3:33739
I20260811 11:09:26.801963 30777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.3:33739 every 8 connection(s)
I20260811 11:09:26.802297 30538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/data/info.pb
I20260811 11:09:26.807559 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.803047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.3:53273 (local address 127.25.227.62:45871)
0811 11:09:26.803099 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.803101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.803380 (+ 279us) server_negotiation.cc:407] Connection header received
0811 11:09:26.803833 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.803834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.803846 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.803914 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.804655 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.805163 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.806222 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.806406 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.806462 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.807305 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.807306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.807306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:26.807310 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.807322 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:26.807325 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.807367 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.807476 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.807498 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:09:26.807891 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30538
I20260811 11:09:26.807904 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.803001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:45871 (local address 127.25.227.3:53273)
0811 11:09:26.803209 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.803252 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.803737 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.804000 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.804004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.804013 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:26.804547 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.804552 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.805340 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.805341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.806118 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.806120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.806484 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.806485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.806595 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.807172 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 11:09:26.807172 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:26.807202 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 11:09:26.807224 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:26.807390 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:26.807397 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:26.807400 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.807480 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.807567 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260811 11:09:26.808008 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal/instance
I20260811 11:09:26.808251 26508 external_mini_cluster.cc:1428] Setting key e5c8ff877442d94beff27ccfb7dfa93e
I20260811 11:09:26.808658 30779 heartbeater.cc:347] Connected to a master server at 127.25.227.62:45871
I20260811 11:09:26.808769 30779 heartbeater.cc:464] Registering TS with master...
I20260811 11:09:26.808954 30779 heartbeater.cc:511] Master 127.25.227.62:45871 requested a full tablet report, sending...
I20260811 11:09:26.809376 29983 ts_manager.cc:194] Registered new tserver with Master: e352d3a384b54e82a658a79467b22c3f (127.25.227.3:33739)
I20260811 11:09:26.809845 26508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 11:09:26.809852 29983 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.227.3:53273
I20260811 11:09:26.814170 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.811347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42500 (local address 127.25.227.62:45871)
0811 11:09:26.811381 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.811384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.811485 (+ 101us) server_negotiation.cc:407] Connection header received
0811 11:09:26.811563 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.811564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.811573 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.811628 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:26.811799 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.812250 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.813011 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.813290 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.813363 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.813933 (+ 570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:26.813934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:26.813934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:26.813939 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:26.813952 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:26.813956 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:26.814003 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.814070 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.814089 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 11:09:26.815518 29983 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 11:09:26.817066 29983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 11:09:26.823521 30798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.819355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57398 (local address 127.25.227.2:40671)
0811 11:09:26.820096 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.820101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.820111 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:26.820150 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.820152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.820168 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.820417 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.820480 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.821540 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.822573 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.823110 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.823202 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.823312 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.823390 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.823430 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":125,"threads_started":1}
I20260811 11:09:26.823508 30796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.819267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.2:40671 (local address 127.0.0.1:57398)
0811 11:09:26.819534 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.819581 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.819649 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.820290 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.820291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.820294 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.820338 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.820339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.821619 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.821621 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.822487 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.822490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.823202 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.823203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.823282 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.823296 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.823375 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.823431 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":59,"threads_started":1}
I20260811 11:09:26.823732 30797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.819277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33739 (local address 127.0.0.1:34844)
0811 11:09:26.819755 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.819763 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.819790 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.820062 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.820063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.820066 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.820119 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.820120 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.821112 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.821114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.822501 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.822503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.823475 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.823476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.823538 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.823542 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.823574 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.823621 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":24,"thread_start_us":90,"threads_started":1}
I20260811 11:09:26.823927 30794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.819276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36023 (local address 127.0.0.1:50874)
0811 11:09:26.819578 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.819591 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.819652 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.819955 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.819959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.819961 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.820026 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.820028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.821378 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.821379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.822497 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.822500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.823562 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.823562 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.823755 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.823760 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.823814 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.823860 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":2,"thread_start_us":62,"threads_started":1}
I20260811 11:09:26.824162 30800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.819492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34844 (local address 127.25.227.3:33739)
0811 11:09:26.819878 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.819881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.819889 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:09:26.819944 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.819946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.819961 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.820280 (+ 319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.820334 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.821023 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.822606 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.823366 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.823906 (+ 540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.824009 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.824037 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.824083 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":97,"threads_started":1}
I20260811 11:09:26.824252 30802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.819538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50874 (local address 127.25.227.1:36023)
0811 11:09:26.819753 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.819757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.819767 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:26.819817 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.819818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.819830 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.819945 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.820118 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.821290 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.822607 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.823366 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.823442 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.823530 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.824103 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.824147 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":98,"threads_started":1}
I20260811 11:09:26.824405 30414 tablet_service.cc:1467] Processing CreateTablet for tablet f00b7ba129c14019bf39ac6f3b8cd509 (DEFAULT_TABLE table=test-table [id=dafd88e1e66448318424bfdeae6d7b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:26.824846 30414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f00b7ba129c14019bf39ac6f3b8cd509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.824806 30663 tablet_service.cc:1467] Processing CreateTablet for tablet f00b7ba129c14019bf39ac6f3b8cd509 (DEFAULT_TABLE table=test-table [id=dafd88e1e66448318424bfdeae6d7b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:26.825062 30663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f00b7ba129c14019bf39ac6f3b8cd509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.824962 30183 tablet_service.cc:1467] Processing CreateTablet for tablet f00b7ba129c14019bf39ac6f3b8cd509 (DEFAULT_TABLE table=test-table [id=dafd88e1e66448318424bfdeae6d7b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 11:09:26.825330 30183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f00b7ba129c14019bf39ac6f3b8cd509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:26.827776 30805 tablet_bootstrap.cc:492] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Bootstrap starting.
I20260811 11:09:26.828605 30805 tablet_bootstrap.cc:654] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.828982 30805 log.cc:824] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.829074 30809 tablet_bootstrap.cc:492] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: Bootstrap starting.
I20260811 11:09:26.829550 30806 tablet_bootstrap.cc:492] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Bootstrap starting.
I20260811 11:09:26.829802 30809 tablet_bootstrap.cc:654] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.829835 30805 tablet_bootstrap.cc:492] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: No bootstrap required, opened a new log
I20260811 11:09:26.829896 30805 ts_tablet_manager.cc:1397] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 11:09:26.830137 30809 log.cc:824] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.830160 30806 tablet_bootstrap.cc:654] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:26.830503 30806 log.cc:824] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:26.830926 30809 tablet_bootstrap.cc:492] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: No bootstrap required, opened a new log
I20260811 11:09:26.831014 30809 ts_tablet_manager.cc:1397] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:26.831394 30806 tablet_bootstrap.cc:492] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: No bootstrap required, opened a new log
I20260811 11:09:26.831475 30806 ts_tablet_manager.cc:1397] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 11:09:26.832324 30805 raft_consensus.cc:348] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.832479 30805 raft_consensus.cc:374] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.832525 30805 raft_consensus.cc:729] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e352d3a384b54e82a658a79467b22c3f, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.832647 30805 consensus_queue.cc:260] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.832973 30779 heartbeater.cc:503] Master 127.25.227.62:45871 was elected leader, sending a full tablet report...
I20260811 11:09:26.832957 30805 ts_tablet_manager.cc:1428] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 11:09:26.833760 30809 raft_consensus.cc:348] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.833922 30809 raft_consensus.cc:374] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.833966 30809 raft_consensus.cc:729] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c67c5ec1a5da4149b6fd859697ccfe8b, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.834074 30809 consensus_queue.cc:260] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.834352 30809 ts_tablet_manager.cc:1428] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 11:09:26.834406 30302 heartbeater.cc:503] Master 127.25.227.62:45871 was elected leader, sending a full tablet report...
I20260811 11:09:26.834614 30806 raft_consensus.cc:348] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.834774 30806 raft_consensus.cc:374] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:26.834836 30806 raft_consensus.cc:729] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1591b78f43544e9aaba5815f3856774, State: Initialized, Role: FOLLOWER
I20260811 11:09:26.834964 30806 consensus_queue.cc:260] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.835263 30806 ts_tablet_manager.cc:1428] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 11:09:26.835323 30532 heartbeater.cc:503] Master 127.25.227.62:45871 was elected leader, sending a full tablet report...
W20260811 11:09:26.893548 30533 tablet.cc:2369] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:09:26.982921 30819 raft_consensus.cc:482] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 11:09:26.983064 30819 raft_consensus.cc:504] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.983518 30819 leader_election.cc:288] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c67c5ec1a5da4149b6fd859697ccfe8b (127.25.227.1:36023), e352d3a384b54e82a658a79467b22c3f (127.25.227.3:33739)
I20260811 11:09:26.986457 30537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.983712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36023 (local address 127.25.227.2:55353)
0811 11:09:26.983797 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.983811 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.983865 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.984043 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.984045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.984046 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.984124 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.984126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.984801 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.984803 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.985622 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.985625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.986166 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.986167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.986260 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.986264 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.986317 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.986369 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 11:09:26.986470 30802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.983780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:55353 (local address 127.25.227.1:36023)
0811 11:09:26.983829 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.983832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.983850 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:09:26.983948 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.983950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.983964 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.984024 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.984200 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.984690 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.985718 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.986081 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.986169 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.986178 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.986342 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.986389 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:09:26.986562 30800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.983828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.25.227.2:39067 (local address 127.25.227.3:33739)
0811 11:09:26.983875 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:26.983877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:26.984062 (+ 185us) server_negotiation.cc:407] Connection header received
0811 11:09:26.984118 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:26.984119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:26.984129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:26.984196 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 11:09:26.984366 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.984838 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.985828 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.986183 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.986284 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.986292 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:26.986441 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 11:09:26.986488 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 11:09:26.986821 30820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:26.983713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.3:33739 (local address 127.25.227.2:39067)
0811 11:09:26.983995 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:26.984002 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:26.984063 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:26.984216 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:26.984217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:26.984219 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 11:09:26.984296 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.984298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.984924 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.984925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.985729 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:26.985732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:26.986289 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:26.986290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:26.986373 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:26.986377 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 11:09:26.986429 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:09:26.986464 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":104,"thread_start_us":126,"threads_started":1}
I20260811 11:09:26.986881 30216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f00b7ba129c14019bf39ac6f3b8cd509" candidate_uuid: "b1591b78f43544e9aaba5815f3856774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" is_pre_election: true
I20260811 11:09:26.987054 30216 raft_consensus.cc:2454] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1591b78f43544e9aaba5815f3856774 in term 0.
I20260811 11:09:26.987208 30691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f00b7ba129c14019bf39ac6f3b8cd509" candidate_uuid: "b1591b78f43544e9aaba5815f3856774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e352d3a384b54e82a658a79467b22c3f" is_pre_election: true
I20260811 11:09:26.987344 30691 raft_consensus.cc:2454] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1591b78f43544e9aaba5815f3856774 in term 0.
I20260811 11:09:26.987346 30331 leader_election.cc:302] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1591b78f43544e9aaba5815f3856774, c67c5ec1a5da4149b6fd859697ccfe8b; no voters:
I20260811 11:09:26.987463 30819 raft_consensus.cc:2781] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 11:09:26.987528 30819 raft_consensus.cc:482] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 11:09:26.987552 30819 raft_consensus.cc:3037] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.988250 30819 raft_consensus.cc:504] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.988395 30819 leader_election.cc:288] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [CANDIDATE]: Term 1 election: Requested vote from peers c67c5ec1a5da4149b6fd859697ccfe8b (127.25.227.1:36023), e352d3a384b54e82a658a79467b22c3f (127.25.227.3:33739)
I20260811 11:09:26.988600 30216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f00b7ba129c14019bf39ac6f3b8cd509" candidate_uuid: "b1591b78f43544e9aaba5815f3856774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b"
I20260811 11:09:26.988600 30691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f00b7ba129c14019bf39ac6f3b8cd509" candidate_uuid: "b1591b78f43544e9aaba5815f3856774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e352d3a384b54e82a658a79467b22c3f"
I20260811 11:09:26.988682 30216 raft_consensus.cc:3037] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.988682 30691 raft_consensus.cc:3037] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:26.989646 30216 raft_consensus.cc:2454] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1591b78f43544e9aaba5815f3856774 in term 1.
I20260811 11:09:26.989646 30691 raft_consensus.cc:2454] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1591b78f43544e9aaba5815f3856774 in term 1.
I20260811 11:09:26.989836 30331 leader_election.cc:302] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1591b78f43544e9aaba5815f3856774, c67c5ec1a5da4149b6fd859697ccfe8b; no voters:
I20260811 11:09:26.989951 30819 raft_consensus.cc:2781] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:26.990105 30819 raft_consensus.cc:686] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 1 LEADER]: Becoming Leader. State: Replica: b1591b78f43544e9aaba5815f3856774, State: Running, Role: LEADER
I20260811 11:09:26.990200 30819 consensus_queue.cc:237] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } }
I20260811 11:09:26.991045 29983 catalog_manager.cc:5495] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1591b78f43544e9aaba5815f3856774 (127.25.227.2). New cstate: current_term: 1 leader_uuid: "b1591b78f43544e9aaba5815f3856774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1591b78f43544e9aaba5815f3856774" member_type: VOTER last_known_addr { host: "127.25.227.2" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 } health_report { overall_health: UNKNOWN } } }
W20260811 11:09:26.992236 30303 tablet.cc:2369] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 11:09:27.004377 30798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:27.002129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57404 (local address 127.25.227.2:40671)
0811 11:09:27.002193 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:27.002195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:27.002205 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:27.002239 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:27.002240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:27.002259 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:27.002325 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:27.002461 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:27.002957 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:27.003660 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:27.003861 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:27.003930 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:27.004064 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:27.004174 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:27.004239 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:27.004281 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 11:09:27.004299 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:09:27.006356 30216 raft_consensus.cc:1261] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 1 FOLLOWER]: Refusing update from remote peer b1591b78f43544e9aaba5815f3856774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:27.006363 30691 raft_consensus.cc:1261] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 1 FOLLOWER]: Refusing update from remote peer b1591b78f43544e9aaba5815f3856774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:27.006739 30819 consensus_queue.cc:1035] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e352d3a384b54e82a658a79467b22c3f" member_type: VOTER last_known_addr { host: "127.25.227.3" port: 33739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:27.006894 30821 consensus_queue.cc:1035] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c67c5ec1a5da4149b6fd859697ccfe8b" member_type: VOTER last_known_addr { host: "127.25.227.1" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:27.009737 30832 mvcc.cc:205] Tried to move back new op lower bound from 7317285138454822912 to 7317285138392367104. Current Snapshot: MvccSnapshot[applied={T|T < 7317285138454822912}]
I20260811 11:09:27.011699 29983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:27.011799 29983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 11:09:27.012526 29983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06a07f54478417fabe5fffdd3c23984: Sending DeleteTablet for 3 replicas of tablet f00b7ba129c14019bf39ac6f3b8cd509
I20260811 11:09:27.012837 30183 tablet_service.cc:1514] Processing DeleteTablet for tablet f00b7ba129c14019bf39ac6f3b8cd509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:27 UTC) from {username='slave'} at 127.0.0.1:50874
I20260811 11:09:27.012912 30414 tablet_service.cc:1514] Processing DeleteTablet for tablet f00b7ba129c14019bf39ac6f3b8cd509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:27 UTC) from {username='slave'} at 127.0.0.1:57398
I20260811 11:09:27.013108 30852 tablet_replica.cc:330] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b: stopping tablet replica
I20260811 11:09:27.013141 30853 tablet_replica.cc:330] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: stopping tablet replica
I20260811 11:09:27.013244 30852 raft_consensus.cc:2229] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:27.013222 30663 tablet_service.cc:1514] Processing DeleteTablet for tablet f00b7ba129c14019bf39ac6f3b8cd509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 11:09:27 UTC) from {username='slave'} at 127.0.0.1:34844
I20260811 11:09:27.013348 30852 raft_consensus.cc:2258] T f00b7ba129c14019bf39ac6f3b8cd509 P c67c5ec1a5da4149b6fd859697ccfe8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:27.013375 30853 raft_consensus.cc:2229] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 1 LEADER]: Raft consensus shutting down.
I20260811 11:09:27.013525 30853 raft_consensus.cc:2258] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:27.013590 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30087
I20260811 11:09:27.014411 30853 ts_tablet_manager.cc:1905] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:27.022465 30853 ts_tablet_manager.cc:1918] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:27.022557 30853 log.cc:1196] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-1/wal/wals/f00b7ba129c14019bf39ac6f3b8cd509
I20260811 11:09:27.022816 30853 ts_tablet_manager.cc:1939] T f00b7ba129c14019bf39ac6f3b8cd509 P b1591b78f43544e9aaba5815f3856774: Deleting consensus metadata
I20260811 11:09:27.023280 29959 catalog_manager.cc:4841] TS b1591b78f43544e9aaba5815f3856774 (127.25.227.2:40671): tablet f00b7ba129c14019bf39ac6f3b8cd509 (table test-table [id=dafd88e1e66448318424bfdeae6d7b35]) successfully deleted
W20260811 11:09:27.027647 29961 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.25.227.1:36023 (error 108)
I20260811 11:09:27.027783 30857 tablet_replica.cc:330] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: stopping tablet replica
I20260811 11:09:27.027936 30857 raft_consensus.cc:2229] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 11:09:27.028076 30857 raft_consensus.cc:2258] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 11:09:27.028193 30794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:27.028059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.1:36023 (local address 127.0.0.1:50888)
0811 11:09:27.028108 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:27.028155 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.1:36023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 11:09:27.028323 29961 catalog_manager.cc:4584] TS c67c5ec1a5da4149b6fd859697ccfe8b (127.25.227.1:36023): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f00b7ba129c14019bf39ac6f3b8cd509: Network error: Client connection negotiation failed: client connection to 127.25.227.1:36023: connect: Connection refused (error 111)
I20260811 11:09:27.028615 30857 ts_tablet_manager.cc:1905] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 11:09:27.028628 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30307
I20260811 11:09:27.032646 30857 ts_tablet_manager.cc:1918] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 11:09:27.032734 30857 log.cc:1196] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Deleting WAL directory at /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786446315517896-26508-0/minicluster-data/ts-2/wal/wals/f00b7ba129c14019bf39ac6f3b8cd509
I20260811 11:09:27.033003 30857 ts_tablet_manager.cc:1939] T f00b7ba129c14019bf39ac6f3b8cd509 P e352d3a384b54e82a658a79467b22c3f: Deleting consensus metadata
I20260811 11:09:27.033506 29960 catalog_manager.cc:4841] TS e352d3a384b54e82a658a79467b22c3f (127.25.227.3:33739): tablet f00b7ba129c14019bf39ac6f3b8cd509 (table test-table [id=dafd88e1e66448318424bfdeae6d7b35]) successfully deleted
I20260811 11:09:27.039978 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30538
I20260811 11:09:27.050060 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 29939
2026-08-11T11:09:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (878 ms)
[----------] 6 tests from EncryptionPolicyTest (9269 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:27 dist-test-slave-z8x9 krb5kdc[30866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:27 dist-test-slave-z8x9 krb5kdc[30866](info): set up 2 sockets
Aug 11 11:09:27 dist-test-slave-z8x9 krb5kdc[30866](info): commencing operation
krb5kdc: starting...
W20260811 11:09:28.370052 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:28 dist-test-slave-z8x9 krb5kdc[30866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:28.496122 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41393
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:28.580195 30887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:28.580454 30887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:28.580494 30887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:28.581700 30887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:28.581772 30887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:28.581796 30887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:28.581817 30887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:28.581848 30887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:28.583348 30887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41393
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:28.583629 30887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:28.583863 30887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:28.588970 30894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:28.589038 30895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:28.589069 30887 server_base.cc:1034] running on GCE node
W20260811 11:09:28.589010 30897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:28.589581 30887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:28.589921 30887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:28.591099 30887 hybrid_clock.cc:648] HybridClock initialized: now 1786446568591085 us; error 48 us; skew 500 ppm
Aug 11 11:09:28 dist-test-slave-z8x9 krb5kdc[30866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446568, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:28.597093 30887 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:28.597580 30887 webserver.cc:460] Webserver started at http://127.0.0.1:35651/ using document root <none> and password file <none>
I20260811 11:09:28.597815 30887 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:28.597886 30887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:28.598049 30887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:28.599195 30887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "4719a4812fb0461dbaad07bfbdea4704"
format_stamp: "Formatted at 2026-08-11 11:09:28 on dist-test-slave-z8x9"
server_key: "418d00d4d478c06c631436d47ec53d6f"
server_key_iv: "576e59e64a2bc4b305171e6ab1400991"
server_key_version: "encryptionkey@0"
I20260811 11:09:28.599578 30887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "4719a4812fb0461dbaad07bfbdea4704"
format_stamp: "Formatted at 2026-08-11 11:09:28 on dist-test-slave-z8x9"
server_key: "418d00d4d478c06c631436d47ec53d6f"
server_key_iv: "576e59e64a2bc4b305171e6ab1400991"
server_key_version: "encryptionkey@0"
I20260811 11:09:28.600931 30887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:09:28.601826 30910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:28.602016 30887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:28.602119 30887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "4719a4812fb0461dbaad07bfbdea4704"
format_stamp: "Formatted at 2026-08-11 11:09:28 on dist-test-slave-z8x9"
server_key: "418d00d4d478c06c631436d47ec53d6f"
server_key_iv: "576e59e64a2bc4b305171e6ab1400991"
server_key_version: "encryptionkey@0"
I20260811 11:09:28.602208 30887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:28.625497 30887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:28.627905 30887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:28.628077 30887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:28.632140 30887 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41393
I20260811 11:09:28.632202 31000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41393 every 8 connection(s)
I20260811 11:09:28.632550 30887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:28.633562 31004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:28.635885 31004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704: Bootstrap starting.
I20260811 11:09:28.636497 31004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:28.636817 31004 log.cc:824] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:28.637655 31004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704: No bootstrap required, opened a new log
I20260811 11:09:28.639277 31004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4719a4812fb0461dbaad07bfbdea4704" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260811 11:09:28.639417 31004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:28.639441 31004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4719a4812fb0461dbaad07bfbdea4704, State: Initialized, Role: FOLLOWER
I20260811 11:09:28.639618 31004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4719a4812fb0461dbaad07bfbdea4704" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260811 11:09:28.639683 31004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:28.639724 31004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:28.639775 31004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:28.640352 31004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4719a4812fb0461dbaad07bfbdea4704" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260811 11:09:28.640471 31004 leader_election.cc:302] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4719a4812fb0461dbaad07bfbdea4704; no voters:
I20260811 11:09:28.640666 31004 leader_election.cc:288] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:28.640727 31010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:28.640925 31010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [term 1 LEADER]: Becoming Leader. State: Replica: 4719a4812fb0461dbaad07bfbdea4704, State: Running, Role: LEADER
I20260811 11:09:28.640938 31004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:28.641043 31010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4719a4812fb0461dbaad07bfbdea4704" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } }
I20260811 11:09:28.641455 31012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4719a4812fb0461dbaad07bfbdea4704. Latest consensus state: current_term: 1 leader_uuid: "4719a4812fb0461dbaad07bfbdea4704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4719a4812fb0461dbaad07bfbdea4704" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } } }
I20260811 11:09:28.641549 31012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:28.641582 31011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4719a4812fb0461dbaad07bfbdea4704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4719a4812fb0461dbaad07bfbdea4704" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41393 } } }
I20260811 11:09:28.641647 31011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:28.641893 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 30887
I20260811 11:09:28.642020 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:28.642259 26508 external_mini_cluster.cc:1428] Setting key 6ba72afefe52ea46493e1cfe54ef1745
W20260811 11:09:28.643025 31038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:09:28.643090 31038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:09:28.643599 31024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:28.643819 31024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:28.645371 31024 catalog_manager.cc:1347] Generated new cluster ID: b8ae4ba753b349f181c95c96c1bc9b3d
I20260811 11:09:28.645430 31024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:09:28 dist-test-slave-z8x9 krb5kdc[30866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:09:28.654279 31045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:28.642840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38943 (local address 127.0.0.1:41393)
0811 11:09:28.643233 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:28.643241 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:28.643270 (+ 29us) server_negotiation.cc:407] Connection header received
0811 11:09:28.643361 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:28.643367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:28.643408 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:28.643522 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:28.644325 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:28.645460 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:28.646579 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:28.647161 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:28.647266 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:28.650160 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:28.650166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:28.650166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:28.650179 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:28.652315 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:28.652771 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:28.652775 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:28.652775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:28.652905 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:28.653149 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:28.653150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:28.653150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:28.653511 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:28.653690 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:28.653811 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 11:09:28.654047 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":74,"threads_started":1}
I20260811 11:09:28.655308 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:28.657073 31024 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:28.657788 31024 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:28.664713 31045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:28.656825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56075 (local address 127.0.0.1:41393)
0811 11:09:28.656908 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:28.656910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:28.657255 (+ 345us) server_negotiation.cc:407] Connection header received
0811 11:09:28.657336 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:28.657337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:28.657348 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:28.657407 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:28.658122 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:28.658842 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:28.659905 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:28.660248 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:28.660289 (+ 41us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:28.661807 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:28.661809 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:28.661809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:28.661816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:28.663368 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:28.663832 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:28.663834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:28.663834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:28.663894 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:28.664122 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:28.664123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:28.664124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:28.664240 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:28.664317 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:28.664555 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 11:09:28.664622 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 11:09:28.669242 31024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4719a4812fb0461dbaad07bfbdea4704: Generated new TSK 0
I20260811 11:09:28.669454 31024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:28.672868 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 30887
W20260811 11:09:28.691975 30862 connection.cc:535] client connection to 127.0.0.1:41393 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41393): Connection reset by peer (error 104)
2026-08-11T11:09:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1627 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:28 dist-test-slave-z8x9 krb5kdc[31059](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:28 dist-test-slave-z8x9 krb5kdc[31059](info): set up 2 sockets
Aug 11 11:09:28 dist-test-slave-z8x9 krb5kdc[31059](info): commencing operation
krb5kdc: starting...
W20260811 11:09:29.982260 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:30 dist-test-slave-z8x9 krb5kdc[31059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:30.104055 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:30.187808 31089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:30.188071 31089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:30.188112 31089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:30.189360 31089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:30.189436 31089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:30.189461 31089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:30.189482 31089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:30.189513 31089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:30.191032 31089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35711
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:30.191329 31089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:30.191577 31089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:09:30.196563 31089 server_base.cc:1034] running on GCE node
W20260811 11:09:30.196533 31099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:30.196537 31094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:30.196558 31096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:30.197009 31089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:30.197351 31089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:30.198513 31089 hybrid_clock.cc:648] HybridClock initialized: now 1786446570198499 us; error 33 us; skew 500 ppm
Aug 11 11:09:30 dist-test-slave-z8x9 krb5kdc[31059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446570, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:30.201426 31089 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:30.201858 31089 webserver.cc:460] Webserver started at http://127.0.0.1:45805/ using document root <none> and password file <none>
I20260811 11:09:30.202072 31089 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:30.202114 31089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:30.202219 31089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:30.203235 31089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "256dbec00e104b7aad9259e532acca11"
format_stamp: "Formatted at 2026-08-11 11:09:30 on dist-test-slave-z8x9"
server_key: "b580ffff3750603be2bf49557f366fd5"
server_key_iv: "d01a62b77cf101bd1eb436541d4c25e9"
server_key_version: "encryptionkey@0"
I20260811 11:09:30.203539 31089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "256dbec00e104b7aad9259e532acca11"
format_stamp: "Formatted at 2026-08-11 11:09:30 on dist-test-slave-z8x9"
server_key: "b580ffff3750603be2bf49557f366fd5"
server_key_iv: "d01a62b77cf101bd1eb436541d4c25e9"
server_key_version: "encryptionkey@0"
I20260811 11:09:30.204978 31089 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 11:09:30.205806 31108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:30.205976 31089 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:30.206064 31089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "256dbec00e104b7aad9259e532acca11"
format_stamp: "Formatted at 2026-08-11 11:09:30 on dist-test-slave-z8x9"
server_key: "b580ffff3750603be2bf49557f366fd5"
server_key_iv: "d01a62b77cf101bd1eb436541d4c25e9"
server_key_version: "encryptionkey@0"
I20260811 11:09:30.206118 31089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:30.225262 31089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:30.227674 31089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:30.227802 31089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:30.231851 31089 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35711
I20260811 11:09:30.231956 31186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35711 every 8 connection(s)
I20260811 11:09:30.232259 31089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:30.233237 31188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:30.235577 31188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11: Bootstrap starting.
I20260811 11:09:30.236181 31188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:30.236492 31188 log.cc:824] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:30.237306 31188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11: No bootstrap required, opened a new log
I20260811 11:09:30.238941 31188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "256dbec00e104b7aad9259e532acca11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260811 11:09:30.239107 31188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:30.239172 31188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256dbec00e104b7aad9259e532acca11, State: Initialized, Role: FOLLOWER
I20260811 11:09:30.239367 31188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "256dbec00e104b7aad9259e532acca11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260811 11:09:30.239475 31188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:30.239521 31188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:30.239571 31188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:30.239799 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31089
I20260811 11:09:30.239933 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:30.240150 26508 external_mini_cluster.cc:1428] Setting key 9faad5d51d7a4a11c895637f551c45ff
I20260811 11:09:30.240270 31188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "256dbec00e104b7aad9259e532acca11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260811 11:09:30.240418 31188 leader_election.cc:302] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 256dbec00e104b7aad9259e532acca11; no voters:
I20260811 11:09:30.240619 31188 leader_election.cc:288] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:30.240717 31197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:30.240919 31188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:30.240919 31197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [term 1 LEADER]: Becoming Leader. State: Replica: 256dbec00e104b7aad9259e532acca11, State: Running, Role: LEADER
I20260811 11:09:30.241544 31197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "256dbec00e104b7aad9259e532acca11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } }
I20260811 11:09:30.242172 31200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "256dbec00e104b7aad9259e532acca11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "256dbec00e104b7aad9259e532acca11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } } }
I20260811 11:09:30.242455 31200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:30.242383 31203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 256dbec00e104b7aad9259e532acca11. Latest consensus state: current_term: 1 leader_uuid: "256dbec00e104b7aad9259e532acca11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "256dbec00e104b7aad9259e532acca11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35711 } } }
I20260811 11:09:30.242748 31203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11 [sys.catalog]: This master's current role is: LEADER
W20260811 11:09:30.243273 31220 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:09:30.243360 31220 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:09:30.243428 31227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:30.243636 31227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:30.245091 31227 catalog_manager.cc:1347] Generated new cluster ID: 0037ef497dd1463c963ea4bcbaacd252
I20260811 11:09:30.245149 31227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:30.246546 31202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:30.240702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39535 (local address 127.0.0.1:35711)
0811 11:09:30.240940 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:30.240951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:30.241052 (+ 101us) server_negotiation.cc:407] Connection header received
0811 11:09:30.241200 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:30.241216 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:30.241289 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:30.241437 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:30.241729 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:30.243305 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:30.244431 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:30.245046 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:30.245156 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:30.245927 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:30.245930 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:30.245930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:30.246123 (+ 193us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:30.246159 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:30.246173 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:30.246255 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:30.246329 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 11:09:30.246355 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":86,"threads_started":1}
I20260811 11:09:30.247466 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:30.251518 31202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:30.248771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46951 (local address 127.0.0.1:35711)
0811 11:09:30.248816 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:30.248818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:30.248904 (+ 86us) server_negotiation.cc:407] Connection header received
0811 11:09:30.248964 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:30.248965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:30.248972 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:30.249018 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:30.249133 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:30.249629 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:30.250345 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:30.250552 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:30.250625 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:30.251272 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:30.251273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:30.251274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:30.251278 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:30.251290 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:30.251294 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:30.251367 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:30.251432 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 11:09:30.251443 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 11:09:30.253288 31227 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:30.253990 31227 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:30.259975 31227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 256dbec00e104b7aad9259e532acca11: Generated new TSK 0
I20260811 11:09:30.260146 31227 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:30.263981 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31089
W20260811 11:09:30.285072 31057 connection.cc:535] client connection to 127.0.0.1:35711 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35711): Connection reset by peer (error 104)
2026-08-11T11:09:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1593 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:30 dist-test-slave-z8x9 krb5kdc[31241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:30 dist-test-slave-z8x9 krb5kdc[31241](info): set up 2 sockets
Aug 11 11:09:30 dist-test-slave-z8x9 krb5kdc[31241](info): commencing operation
krb5kdc: starting...
W20260811 11:09:31.570904 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:31 dist-test-slave-z8x9 krb5kdc[31241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:31.692154 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38691
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38691
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:31.775391 31264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:31.775642 31264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:31.775683 31264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:31.776829 31264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:31.776898 31264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:31.776922 31264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:31.776942 31264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:31.776973 31264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:31.778481 31264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38691
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:31.778779 31264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:31.779012 31264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:31.783847 31272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:31.783869 31276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:31.783869 31273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:31.783890 31264 server_base.cc:1034] running on GCE node
I20260811 11:09:31.784356 31264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:31.784647 31264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:31.785809 31264 hybrid_clock.cc:648] HybridClock initialized: now 1786446571785803 us; error 37 us; skew 500 ppm
Aug 11 11:09:31 dist-test-slave-z8x9 krb5kdc[31241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446571, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:31.788337 31264 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:31.788808 31264 webserver.cc:460] Webserver started at http://127.0.0.1:34167/ using document root <none> and password file <none>
I20260811 11:09:31.789055 31264 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:31.789125 31264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:31.789305 31264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:31.790362 31264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "760c1fdb1c4b486fb31ab002389ae40f"
format_stamp: "Formatted at 2026-08-11 11:09:31 on dist-test-slave-z8x9"
server_key: "a472da8546c27bd772cd3792099b4f0e"
server_key_iv: "78e8c851e3e6e8b3896ad27f7f5b6105"
server_key_version: "encryptionkey@0"
I20260811 11:09:31.790735 31264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "760c1fdb1c4b486fb31ab002389ae40f"
format_stamp: "Formatted at 2026-08-11 11:09:31 on dist-test-slave-z8x9"
server_key: "a472da8546c27bd772cd3792099b4f0e"
server_key_iv: "78e8c851e3e6e8b3896ad27f7f5b6105"
server_key_version: "encryptionkey@0"
I20260811 11:09:31.792191 31264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:31.792960 31287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:31.793206 31264 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:31.793352 31264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "760c1fdb1c4b486fb31ab002389ae40f"
format_stamp: "Formatted at 2026-08-11 11:09:31 on dist-test-slave-z8x9"
server_key: "a472da8546c27bd772cd3792099b4f0e"
server_key_iv: "78e8c851e3e6e8b3896ad27f7f5b6105"
server_key_version: "encryptionkey@0"
I20260811 11:09:31.793438 31264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:31.796747 31264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:31.798841 31264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:31.799000 31264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:31.803134 31264 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38691
I20260811 11:09:31.803180 31377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38691 every 8 connection(s)
I20260811 11:09:31.803527 31264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:31.804509 31378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:31.806777 31378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f: Bootstrap starting.
I20260811 11:09:31.807195 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31264
I20260811 11:09:31.807330 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:31.807497 31378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:31.807549 26508 external_mini_cluster.cc:1428] Setting key 8e58f0af6ce851fd58e71db823b16524
I20260811 11:09:31.807826 31378 log.cc:824] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:31.808555 31378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f: No bootstrap required, opened a new log
I20260811 11:09:31.810118 31383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:31.808004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56763 (local address 127.0.0.1:38691)
0811 11:09:31.808191 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:31.808200 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:31.808236 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:09:31.808724 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:31.808731 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:31.808775 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:31.808917 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:31.809659 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:31.809663 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:31.809664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:31.809669 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:31.809716 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:31.809727 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:31.809840 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:31.809879 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 11:09:31.809920 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260811 11:09:31.810938 31378 raft_consensus.cc:348] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760c1fdb1c4b486fb31ab002389ae40f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38691 } }
I20260811 11:09:31.811110 31378 raft_consensus.cc:374] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:31.811149 31378 raft_consensus.cc:729] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 760c1fdb1c4b486fb31ab002389ae40f, State: Initialized, Role: FOLLOWER
I20260811 11:09:31.811280 31378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760c1fdb1c4b486fb31ab002389ae40f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38691 } }
I20260811 11:09:31.811340 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:31.811386 31378 raft_consensus.cc:388] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:31.811456 31378 raft_consensus.cc:482] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:31.811507 31378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:31.812036 31378 raft_consensus.cc:504] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760c1fdb1c4b486fb31ab002389ae40f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38691 } }
I20260811 11:09:31.812240 31378 leader_election.cc:302] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 760c1fdb1c4b486fb31ab002389ae40f; no voters:
I20260811 11:09:31.812458 31378 leader_election.cc:288] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:31.812480 31390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:31.812685 31390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [term 1 LEADER]: Becoming Leader. State: Replica: 760c1fdb1c4b486fb31ab002389ae40f, State: Running, Role: LEADER
I20260811 11:09:31.812716 31378 sys_catalog.cc:564] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:31.812779 31390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760c1fdb1c4b486fb31ab002389ae40f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38691 } }
I20260811 11:09:31.813251 31398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "760c1fdb1c4b486fb31ab002389ae40f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760c1fdb1c4b486fb31ab002389ae40f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38691 } } }
I20260811 11:09:31.813375 31398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:31.813433 31390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 760c1fdb1c4b486fb31ab002389ae40f. Latest consensus state: current_term: 1 leader_uuid: "760c1fdb1c4b486fb31ab002389ae40f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760c1fdb1c4b486fb31ab002389ae40f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38691 } } }
I20260811 11:09:31.813941 31390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:31.813805 31410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:31.814503 31383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:31.812950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34991 (local address 127.0.0.1:38691)
0811 11:09:31.812980 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:31.812982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:31.813108 (+ 126us) server_negotiation.cc:407] Connection header received
0811 11:09:31.813214 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:31.813215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:31.813220 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:31.813252 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:31.814035 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:31.814036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:31.814036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:31.814042 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:31.814055 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:31.814060 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:31.814090 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:31.814309 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 11:09:31.814323 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 11:09:31.814877 31410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:31.816248 31410 catalog_manager.cc:1347] Generated new cluster ID: c6455374501b43a583472c8531f636b5
I20260811 11:09:31.816304 31410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:31.825986 31410 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:31.826160 31410 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:31.833678 31410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 760c1fdb1c4b486fb31ab002389ae40f: Generated new TSK 0
I20260811 11:09:31.833870 31410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:31.837548 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31264
2026-08-11T11:09:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1566 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:31 dist-test-slave-z8x9 krb5kdc[31426](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:31 dist-test-slave-z8x9 krb5kdc[31426](info): set up 2 sockets
Aug 11 11:09:31 dist-test-slave-z8x9 krb5kdc[31426](info): commencing operation
krb5kdc: starting...
W20260811 11:09:33.333660 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.468s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:33 dist-test-slave-z8x9 krb5kdc[31426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:33.458050 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45753
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:33.541363 31446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:33.541602 31446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:33.541653 31446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:33.542821 31446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:33.542891 31446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:33.542917 31446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:33.542938 31446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:33.542966 31446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:33.544456 31446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:33.544745 31446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:33.544987 31446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:33.549904 31458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:33.549908 31462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:33.549901 31456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:33.550428 31446 server_base.cc:1034] running on GCE node
I20260811 11:09:33.550704 31446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:33.551011 31446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:33.552158 31446 hybrid_clock.cc:648] HybridClock initialized: now 1786446573552143 us; error 30 us; skew 500 ppm
Aug 11 11:09:33 dist-test-slave-z8x9 krb5kdc[31426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446573, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:33.554780 31446 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:33.555272 31446 webserver.cc:460] Webserver started at http://127.0.0.1:40453/ using document root <none> and password file <none>
I20260811 11:09:33.555527 31446 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:33.555600 31446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:33.555755 31446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:33.556819 31446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "8dfb79e17ad649da981103939a37ff1b"
format_stamp: "Formatted at 2026-08-11 11:09:33 on dist-test-slave-z8x9"
server_key: "fdb353a792abc920d77baa0f4046ebaf"
server_key_iv: "d6990aa699366477b850207798485ede"
server_key_version: "encryptionkey@0"
I20260811 11:09:33.557256 31446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "8dfb79e17ad649da981103939a37ff1b"
format_stamp: "Formatted at 2026-08-11 11:09:33 on dist-test-slave-z8x9"
server_key: "fdb353a792abc920d77baa0f4046ebaf"
server_key_iv: "d6990aa699366477b850207798485ede"
server_key_version: "encryptionkey@0"
I20260811 11:09:33.558607 31446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:33.559362 31472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:33.559544 31446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:33.559648 31446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "8dfb79e17ad649da981103939a37ff1b"
format_stamp: "Formatted at 2026-08-11 11:09:33 on dist-test-slave-z8x9"
server_key: "fdb353a792abc920d77baa0f4046ebaf"
server_key_iv: "d6990aa699366477b850207798485ede"
server_key_version: "encryptionkey@0"
I20260811 11:09:33.559731 31446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:33.576210 31446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:33.578238 31446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:33.578408 31446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:33.582567 31446 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45753
I20260811 11:09:33.582604 31571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45753 every 8 connection(s)
I20260811 11:09:33.582991 31446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:33.583913 31572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:33.586246 31572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b: Bootstrap starting.
I20260811 11:09:33.586792 31572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:33.587030 31572 log.cc:824] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:33.587687 31572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b: No bootstrap required, opened a new log
I20260811 11:09:33.589318 31572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfb79e17ad649da981103939a37ff1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45753 } }
I20260811 11:09:33.589454 31572 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:33.589478 31572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfb79e17ad649da981103939a37ff1b, State: Initialized, Role: FOLLOWER
I20260811 11:09:33.589607 31572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfb79e17ad649da981103939a37ff1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45753 } }
I20260811 11:09:33.589689 31572 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:33.589711 31572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:33.589740 31572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:33.590210 31572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfb79e17ad649da981103939a37ff1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45753 } }
I20260811 11:09:33.590298 31572 leader_election.cc:302] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dfb79e17ad649da981103939a37ff1b; no voters:
I20260811 11:09:33.590425 31572 leader_election.cc:288] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:33.590495 31575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:33.590673 31575 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 8dfb79e17ad649da981103939a37ff1b, State: Running, Role: LEADER
I20260811 11:09:33.590700 31572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:33.590766 31575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfb79e17ad649da981103939a37ff1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45753 } }
I20260811 11:09:33.591197 31578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dfb79e17ad649da981103939a37ff1b. Latest consensus state: current_term: 1 leader_uuid: "8dfb79e17ad649da981103939a37ff1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfb79e17ad649da981103939a37ff1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45753 } } }
I20260811 11:09:33.591325 31578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:33.591416 31576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dfb79e17ad649da981103939a37ff1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfb79e17ad649da981103939a37ff1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45753 } } }
I20260811 11:09:33.591547 31576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:33.591967 31593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:33.592515 31593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:33.593092 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31446
I20260811 11:09:33.593256 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:33.593467 26508 external_mini_cluster.cc:1428] Setting key d799798db881e30afd5180256a6cc185
I20260811 11:09:33.594300 31593 catalog_manager.cc:1347] Generated new cluster ID: d10938440b4141ab8b4497af1fd91509
I20260811 11:09:33.594357 31593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:33.600837 31593 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:33.601558 31593 catalog_manager.cc:1504] Loading token signing keys...
Aug 11 11:09:33 dist-test-slave-z8x9 krb5kdc[31426](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:09:33.607111 31593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dfb79e17ad649da981103939a37ff1b: Generated new TSK 0
I20260811 11:09:33.607286 31593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:33.607632 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:33.594177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43105 (local address 127.0.0.1:45753)
0811 11:09:33.594357 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:33.594367 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:33.594431 (+ 64us) server_negotiation.cc:407] Connection header received
0811 11:09:33.594538 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:33.594544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:33.594588 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:33.594729 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:33.595386 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:33.596318 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:33.597088 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:33.597630 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:33.597771 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:33.603963 (+ 6192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:33.603973 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:33.603973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:33.603984 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:33.605713 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:33.606089 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:33.606092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:33.606092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:33.606186 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:33.606412 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:33.606413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:33.606413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:33.606636 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:33.606804 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:33.607257 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 11:09:33.607444 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
I20260811 11:09:33.608593 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:33.616091 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:33.610063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49653 (local address 127.0.0.1:45753)
0811 11:09:33.610102 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:33.610103 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:33.610248 (+ 145us) server_negotiation.cc:407] Connection header received
0811 11:09:33.610328 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:33.610329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:33.610339 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:33.610388 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:33.610900 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:33.611379 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:33.612108 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:33.612339 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:33.612414 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:33.613617 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:33.613618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:33.613618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:33.613626 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:33.614970 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:33.615315 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:33.615316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:33.615316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:33.615376 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:33.615580 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:33.615581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:33.615581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:33.615688 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:33.615820 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:33.615916 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 11:09:33.615995 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 11:09:33.618204 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31446
2026-08-11T11:09:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1779 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:33 dist-test-slave-z8x9 krb5kdc[31627](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:33 dist-test-slave-z8x9 krb5kdc[31627](info): set up 2 sockets
Aug 11 11:09:33 dist-test-slave-z8x9 krb5kdc[31627](info): commencing operation
krb5kdc: starting...
W20260811 11:09:34.934178 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:35 dist-test-slave-z8x9 krb5kdc[31627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:35.060030 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45167
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:35.146618 31643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:35.146870 31643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:35.146914 31643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:35.148077 31643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:35.148155 31643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:35.148183 31643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:35.148216 31643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:35.148239 31643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:35.149780 31643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:35.150068 31643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:35.150319 31643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:35.155315 31649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:35.155469 31643 server_base.cc:1034] running on GCE node
W20260811 11:09:35.155364 31653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:35.155365 31650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:35.155922 31643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:35.156188 31643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:35.157325 31643 hybrid_clock.cc:648] HybridClock initialized: now 1786446575157305 us; error 44 us; skew 500 ppm
Aug 11 11:09:35 dist-test-slave-z8x9 krb5kdc[31627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446575, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:35.159955 31643 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:35.160445 31643 webserver.cc:460] Webserver started at http://127.0.0.1:39183/ using document root <none> and password file <none>
I20260811 11:09:35.160717 31643 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:35.160791 31643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:35.160943 31643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:35.162119 31643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c"
format_stamp: "Formatted at 2026-08-11 11:09:35 on dist-test-slave-z8x9"
server_key: "fde7512fbd8de4c20c916fb30a4e27b9"
server_key_iv: "47912c30557425bcc540454a0207c086"
server_key_version: "encryptionkey@0"
I20260811 11:09:35.162495 31643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c"
format_stamp: "Formatted at 2026-08-11 11:09:35 on dist-test-slave-z8x9"
server_key: "fde7512fbd8de4c20c916fb30a4e27b9"
server_key_iv: "47912c30557425bcc540454a0207c086"
server_key_version: "encryptionkey@0"
I20260811 11:09:35.163883 31643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:35.164669 31664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:35.164856 31643 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:35.164969 31643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c"
format_stamp: "Formatted at 2026-08-11 11:09:35 on dist-test-slave-z8x9"
server_key: "fde7512fbd8de4c20c916fb30a4e27b9"
server_key_iv: "47912c30557425bcc540454a0207c086"
server_key_version: "encryptionkey@0"
I20260811 11:09:35.165048 31643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:35.180102 31643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:35.182163 31643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:35.182355 31643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:35.186461 31643 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45167
I20260811 11:09:35.186497 31751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45167 every 8 connection(s)
I20260811 11:09:35.186866 31643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:35.187793 31753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:35.190198 31753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c: Bootstrap starting.
I20260811 11:09:35.190840 31753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:35.191161 31753 log.cc:824] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:35.191908 31753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c: No bootstrap required, opened a new log
I20260811 11:09:35.193616 31753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45167 } }
I20260811 11:09:35.193766 31753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:35.193791 31753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5c9b62c9a94c39b8310e2a2dfd791c, State: Initialized, Role: FOLLOWER
I20260811 11:09:35.193974 31753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45167 } }
I20260811 11:09:35.194062 31753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:35.194118 31753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:35.194175 31753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:35.194734 31753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45167 } }
I20260811 11:09:35.194860 31753 leader_election.cc:302] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c5c9b62c9a94c39b8310e2a2dfd791c; no voters:
I20260811 11:09:35.195053 31753 leader_election.cc:288] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:35.195115 31758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:35.195317 31758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [term 1 LEADER]: Becoming Leader. State: Replica: 2c5c9b62c9a94c39b8310e2a2dfd791c, State: Running, Role: LEADER
I20260811 11:09:35.195338 31753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:35.195416 31758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45167 } }
I20260811 11:09:35.195574 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31643
I20260811 11:09:35.195690 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:35.195892 26508 external_mini_cluster.cc:1428] Setting key d7cd7b0597a7cee826bb459920640d93
I20260811 11:09:35.196303 31764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c5c9b62c9a94c39b8310e2a2dfd791c. Latest consensus state: current_term: 1 leader_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45167 } } }
I20260811 11:09:35.196403 31764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:35.196650 31760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5c9b62c9a94c39b8310e2a2dfd791c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45167 } } }
I20260811 11:09:35.196714 31760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:35.197839 31772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:35.198447 31772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:35.199934 31772 catalog_manager.cc:1347] Generated new cluster ID: 9204715b69a447f898c55b054f70a4d2
I20260811 11:09:35.199988 31772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:35.203143 31780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:35.196580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32777 (local address 127.0.0.1:45167)
0811 11:09:35.197726 (+ 1146us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:35.197737 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:35.197794 (+ 57us) server_negotiation.cc:407] Connection header received
0811 11:09:35.197928 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:35.197937 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:35.198000 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:35.198135 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:35.198425 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:35.199847 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:35.200971 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:35.201590 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:35.201694 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:35.202454 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:35.202458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:35.202459 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:35.202668 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:35.202708 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:35.202722 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:35.202793 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:35.202891 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 11:09:35.202949 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1089,"thread_start_us":289,"threads_started":1}
I20260811 11:09:35.204051 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:35.208992 31780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:35.205699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53859 (local address 127.0.0.1:45167)
0811 11:09:35.205731 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:35.205733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:35.205778 (+ 45us) server_negotiation.cc:407] Connection header received
0811 11:09:35.205861 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:35.205862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:35.205871 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:35.205920 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:35.206060 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:35.206736 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:35.207739 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:35.208024 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:35.208080 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:35.208765 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:35.208766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:35.208766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:35.208771 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:35.208785 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:35.208790 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:35.208838 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:35.208901 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:09:35.208923 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:09:35.211329 31772 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:35.211846 31772 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:35.216353 31772 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c5c9b62c9a94c39b8310e2a2dfd791c: Generated new TSK 0
I20260811 11:09:35.216535 31772 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:35.221552 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31643
2026-08-11T11:09:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:35 dist-test-slave-z8x9 krb5kdc[31814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:35 dist-test-slave-z8x9 krb5kdc[31814](info): set up 2 sockets
Aug 11 11:09:35 dist-test-slave-z8x9 krb5kdc[31814](info): commencing operation
krb5kdc: starting...
W20260811 11:09:36.547685 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:36 dist-test-slave-z8x9 krb5kdc[31814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:36.674486 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37189
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:36.767778 31843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:36.767976 31843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:36.768000 31843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:36.769109 31843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:36.769143 31843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:36.769157 31843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:36.769224 31843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:36.769254 31843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:36.770644 31843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:36.770829 31843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:36.771001 31843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:36.776005 31850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:36.776060 31856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:36.776005 31853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:36.776285 31843 server_base.cc:1034] running on GCE node
I20260811 11:09:36.776528 31843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:36.776768 31843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:36.777907 31843 hybrid_clock.cc:648] HybridClock initialized: now 1786446576777885 us; error 38 us; skew 500 ppm
Aug 11 11:09:36 dist-test-slave-z8x9 krb5kdc[31814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446576, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:36.780478 31843 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:36.780900 31843 webserver.cc:460] Webserver started at http://127.0.0.1:34299/ using document root <none> and password file <none>
I20260811 11:09:36.781083 31843 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:36.781123 31843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:36.781279 31843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:36.782299 31843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "cf6f1838e38449d595e486e614753494"
format_stamp: "Formatted at 2026-08-11 11:09:36 on dist-test-slave-z8x9"
server_key: "ed487a2c5d0a38f46d8ae0a331805fc5"
server_key_iv: "85978b3dcdd628474f71d3024386ebf8"
server_key_version: "encryptionkey@0"
I20260811 11:09:36.782599 31843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "cf6f1838e38449d595e486e614753494"
format_stamp: "Formatted at 2026-08-11 11:09:36 on dist-test-slave-z8x9"
server_key: "ed487a2c5d0a38f46d8ae0a331805fc5"
server_key_iv: "85978b3dcdd628474f71d3024386ebf8"
server_key_version: "encryptionkey@0"
I20260811 11:09:36.783869 31843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 11:09:36.784561 31871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:36.784714 31843 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:36.784804 31843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "cf6f1838e38449d595e486e614753494"
format_stamp: "Formatted at 2026-08-11 11:09:36 on dist-test-slave-z8x9"
server_key: "ed487a2c5d0a38f46d8ae0a331805fc5"
server_key_iv: "85978b3dcdd628474f71d3024386ebf8"
server_key_version: "encryptionkey@0"
I20260811 11:09:36.784859 31843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:36.788048 31843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:36.789929 31843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:36.790033 31843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:36.793887 31843 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37189
I20260811 11:09:36.793941 31953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37189 every 8 connection(s)
I20260811 11:09:36.794256 31843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:36.795266 31954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:36.797705 31954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494: Bootstrap starting.
I20260811 11:09:36.798322 31954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:36.798635 31954 log.cc:824] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:36.799374 31954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494: No bootstrap required, opened a new log
I20260811 11:09:36.800980 31954 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf6f1838e38449d595e486e614753494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37189 } }
I20260811 11:09:36.801141 31954 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:36.801229 31954 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf6f1838e38449d595e486e614753494, State: Initialized, Role: FOLLOWER
I20260811 11:09:36.801417 31954 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf6f1838e38449d595e486e614753494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37189 } }
I20260811 11:09:36.801522 31954 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:36.801568 31954 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:36.801620 31954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:36.801849 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 31843
I20260811 11:09:36.801973 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:36.802172 26508 external_mini_cluster.cc:1428] Setting key c7625006772012de47a0ca891baa75ef
I20260811 11:09:36.802281 31954 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf6f1838e38449d595e486e614753494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37189 } }
I20260811 11:09:36.802402 31954 leader_election.cc:302] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf6f1838e38449d595e486e614753494; no voters:
I20260811 11:09:36.802644 31957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:36.802788 31954 leader_election.cc:288] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:36.802861 31957 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [term 1 LEADER]: Becoming Leader. State: Replica: cf6f1838e38449d595e486e614753494, State: Running, Role: LEADER
I20260811 11:09:36.802966 31957 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf6f1838e38449d595e486e614753494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37189 } }
I20260811 11:09:36.803102 31954 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:36.803280 31957 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf6f1838e38449d595e486e614753494. Latest consensus state: current_term: 1 leader_uuid: "cf6f1838e38449d595e486e614753494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf6f1838e38449d595e486e614753494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37189 } } }
I20260811 11:09:36.803373 31957 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:36.803609 31957 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf6f1838e38449d595e486e614753494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf6f1838e38449d595e486e614753494" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37189 } } }
I20260811 11:09:36.803679 31957 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:36.803818 31965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:36.804463 31965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:36.805627 31960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:36.802676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51687 (local address 127.0.0.1:37189)
0811 11:09:36.802963 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:36.802973 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:36.803006 (+ 33us) server_negotiation.cc:407] Connection header received
0811 11:09:36.803118 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:36.803125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:36.803155 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:36.803604 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:36.804421 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:36.804425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:36.804425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:36.804430 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:36.804475 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:36.804490 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:36.804688 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:36.804726 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 11:09:36.804954 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":67,"threads_started":1}
I20260811 11:09:36.807042 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:36.807112 31965 catalog_manager.cc:1347] Generated new cluster ID: 4d1aeb36759342f9b08e204db0a433d4
I20260811 11:09:36.807191 31965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:36.814327 31960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:36.809506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58273 (local address 127.0.0.1:37189)
0811 11:09:36.809541 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:36.809544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:36.813343 (+ 3799us) server_negotiation.cc:407] Connection header received
0811 11:09:36.813393 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:36.813394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:36.813400 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:36.813458 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:36.814098 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:36.814099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:36.814100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:36.814104 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:36.814121 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:36.814126 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:36.814190 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:36.814245 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 11:09:36.814258 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:09:36.821729 31965 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:36.821902 31965 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:36.833782 31965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf6f1838e38449d595e486e614753494: Generated new TSK 0
I20260811 11:09:36.834017 31965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:36.843556 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 31843
2026-08-11T11:09:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1626 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:36 dist-test-slave-z8x9 krb5kdc[32002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:36 dist-test-slave-z8x9 krb5kdc[32002](info): set up 2 sockets
Aug 11 11:09:36 dist-test-slave-z8x9 krb5kdc[32002](info): commencing operation
krb5kdc: starting...
W20260811 11:09:38.150373 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:38 dist-test-slave-z8x9 krb5kdc[32002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:38.280014 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42613
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:38.363263 32026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:38.363461 32026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:38.363483 32026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:38.364542 32026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:38.364576 32026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:38.364590 32026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:38.364603 32026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:38.364615 32026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:38.366065 32026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:38.366259 32026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:38.366437 32026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:38.371520 32035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:38.371513 32037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:38.371512 32034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:38.371590 32026 server_base.cc:1034] running on GCE node
I20260811 11:09:38.371950 32026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:38.372198 32026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:38.373381 32026 hybrid_clock.cc:648] HybridClock initialized: now 1786446578373357 us; error 39 us; skew 500 ppm
Aug 11 11:09:38 dist-test-slave-z8x9 krb5kdc[32002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446578, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:38.375900 32026 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:38.376358 32026 webserver.cc:460] Webserver started at http://127.0.0.1:44715/ using document root <none> and password file <none>
I20260811 11:09:38.376617 32026 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:38.376662 32026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:38.376820 32026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:38.377935 32026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "e4f11910855e4a768e4075189f1eb700"
format_stamp: "Formatted at 2026-08-11 11:09:38 on dist-test-slave-z8x9"
server_key: "355e78ac583745805ef2da05c3c68f21"
server_key_iv: "65a7ec49b3bb63e85b5a8757a57747fe"
server_key_version: "encryptionkey@0"
I20260811 11:09:38.378283 32026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "e4f11910855e4a768e4075189f1eb700"
format_stamp: "Formatted at 2026-08-11 11:09:38 on dist-test-slave-z8x9"
server_key: "355e78ac583745805ef2da05c3c68f21"
server_key_iv: "65a7ec49b3bb63e85b5a8757a57747fe"
server_key_version: "encryptionkey@0"
I20260811 11:09:38.379603 32026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 11:09:38.380330 32049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:38.380532 32026 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:38.380620 32026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "e4f11910855e4a768e4075189f1eb700"
format_stamp: "Formatted at 2026-08-11 11:09:38 on dist-test-slave-z8x9"
server_key: "355e78ac583745805ef2da05c3c68f21"
server_key_iv: "65a7ec49b3bb63e85b5a8757a57747fe"
server_key_version: "encryptionkey@0"
I20260811 11:09:38.380673 32026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:38.397576 32026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:38.399883 32026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:38.399995 32026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:38.403978 32026 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42613
I20260811 11:09:38.404042 32129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42613 every 8 connection(s)
I20260811 11:09:38.404397 32026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:38.405342 32135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:38.405619 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32026
I20260811 11:09:38.405742 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:38.405951 26508 external_mini_cluster.cc:1428] Setting key 1f745286721d6faa74d8f02fe9eca50b
I20260811 11:09:38.408538 32135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700: Bootstrap starting.
I20260811 11:09:38.409305 32135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:38.409600 32135 log.cc:824] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:38.410359 32135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700: No bootstrap required, opened a new log
I20260811 11:09:38.412206 32135 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4f11910855e4a768e4075189f1eb700" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42613 } }
I20260811 11:09:38.412345 32135 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:38.412369 32135 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4f11910855e4a768e4075189f1eb700, State: Initialized, Role: FOLLOWER
I20260811 11:09:38.412504 32135 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4f11910855e4a768e4075189f1eb700" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42613 } }
I20260811 11:09:38.412593 32135 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:38.412627 32135 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:38.412686 32135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 11:09:38 dist-test-slave-z8x9 krb5kdc[32002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:09:38.413458 32135 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4f11910855e4a768e4075189f1eb700" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42613 } }
I20260811 11:09:38.413581 32135 leader_election.cc:302] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4f11910855e4a768e4075189f1eb700; no voters:
I20260811 11:09:38.413757 32135 leader_election.cc:288] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:38.413857 32144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:38.414050 32135 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:38.414063 32144 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [term 1 LEADER]: Becoming Leader. State: Replica: e4f11910855e4a768e4075189f1eb700, State: Running, Role: LEADER
I20260811 11:09:38.414168 32144 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4f11910855e4a768e4075189f1eb700" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42613 } }
I20260811 11:09:38.414505 32144 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4f11910855e4a768e4075189f1eb700. Latest consensus state: current_term: 1 leader_uuid: "e4f11910855e4a768e4075189f1eb700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4f11910855e4a768e4075189f1eb700" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42613 } } }
I20260811 11:09:38.414573 32144 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:38.414675 32145 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4f11910855e4a768e4075189f1eb700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4f11910855e4a768e4075189f1eb700" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42613 } } }
I20260811 11:09:38.414813 32145 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:38.415340 32148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:38.415870 32148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:38.417470 32148 catalog_manager.cc:1347] Generated new cluster ID: 5692665981f74641a6ac934487b2763e
I20260811 11:09:38.417527 32148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:38.418246 32139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:38.406603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:54899 (local address 127.0.0.1:42613)
0811 11:09:38.406820 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:38.406831 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:38.406866 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:09:38.407400 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:38.407410 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:38.407476 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:38.407631 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:38.408242 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:38.409607 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:38.410552 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:38.410970 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:38.411097 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:38.413830 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:38.413835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:38.413835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:38.413849 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:38.416408 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:38.416866 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:38.416869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:38.416870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:38.416980 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:38.417286 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:38.417287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:38.417288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:38.417652 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:38.417833 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:38.417967 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 11:09:38.418073 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":90,"threads_started":1}
I20260811 11:09:38.422175 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:38.430075 32139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:38.423574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:50293 (local address 127.0.0.1:42613)
0811 11:09:38.423612 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:38.423615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:38.423768 (+ 153us) server_negotiation.cc:407] Connection header received
0811 11:09:38.423824 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:38.423825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:38.423835 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:38.423891 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:38.424412 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:38.424899 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:38.425686 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:38.425933 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:38.426011 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:38.427206 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:38.427207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:38.427207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:38.427215 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:38.428807 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:38.429212 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:38.429214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:38.429214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:38.429276 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:38.429524 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:38.429525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:38.429525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:38.429641 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:38.429770 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:38.429892 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 11:09:38.429957 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:09:38.448060 32148 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:38.448815 32148 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:38.452841 32148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4f11910855e4a768e4075189f1eb700: Generated new TSK 0
I20260811 11:09:38.453024 32148 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:38.455477 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32026
W20260811 11:09:38.479914 31998 connection.cc:535] client connection to 127.0.0.1:42613 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42613): Connection reset by peer (error 104)
2026-08-11T11:09:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1616 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:38 dist-test-slave-z8x9 krb5kdc[32180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:38 dist-test-slave-z8x9 krb5kdc[32180](info): set up 2 sockets
Aug 11 11:09:38 dist-test-slave-z8x9 krb5kdc[32180](info): commencing operation
krb5kdc: starting...
W20260811 11:09:39.772235 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:39 dist-test-slave-z8x9 krb5kdc[32180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:39.897773 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33783
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33783
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:39.981153 32211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:39.981446 32211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:39.981487 32211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:39.982636 32211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:39.982712 32211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:39.982735 32211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:39.982775 32211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:39.982800 32211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:39.984272 32211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:39.984561 32211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:39.984798 32211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:39.989786 32219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:39.989804 32211 server_base.cc:1034] running on GCE node
W20260811 11:09:39.989786 32226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:39.989902 32221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:39.990311 32211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:39.990631 32211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:39.991787 32211 hybrid_clock.cc:648] HybridClock initialized: now 1786446579991771 us; error 43 us; skew 500 ppm
Aug 11 11:09:39 dist-test-slave-z8x9 krb5kdc[32180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446579, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:39.998346 32211 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:39.998835 32211 webserver.cc:460] Webserver started at http://127.0.0.1:41863/ using document root <none> and password file <none>
I20260811 11:09:39.999032 32211 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:39.999071 32211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:39.999163 32211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:40.000204 32211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "8a4b1db2addb4016a11a128b0ad63f9d"
format_stamp: "Formatted at 2026-08-11 11:09:39 on dist-test-slave-z8x9"
server_key: "c49ca569ad2d785ee8cd49a7e81564d5"
server_key_iv: "fdcabdae16d284f495c7234745da806d"
server_key_version: "encryptionkey@0"
I20260811 11:09:40.000515 32211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "8a4b1db2addb4016a11a128b0ad63f9d"
format_stamp: "Formatted at 2026-08-11 11:09:39 on dist-test-slave-z8x9"
server_key: "c49ca569ad2d785ee8cd49a7e81564d5"
server_key_iv: "fdcabdae16d284f495c7234745da806d"
server_key_version: "encryptionkey@0"
I20260811 11:09:40.001982 32211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:40.002801 32236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:40.003027 32211 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:40.003144 32211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "8a4b1db2addb4016a11a128b0ad63f9d"
format_stamp: "Formatted at 2026-08-11 11:09:39 on dist-test-slave-z8x9"
server_key: "c49ca569ad2d785ee8cd49a7e81564d5"
server_key_iv: "fdcabdae16d284f495c7234745da806d"
server_key_version: "encryptionkey@0"
I20260811 11:09:40.003227 32211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:40.012025 32211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:40.014484 32211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:40.014655 32211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:40.018834 32211 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33783
I20260811 11:09:40.018895 32314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33783 every 8 connection(s)
I20260811 11:09:40.019290 32211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:40.020203 32315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:40.022572 32315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d: Bootstrap starting.
I20260811 11:09:40.022840 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32211
I20260811 11:09:40.022991 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:40.023190 26508 external_mini_cluster.cc:1428] Setting key eeb68f4387075274c2e7638dc23f4eff
I20260811 11:09:40.023370 32315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:40.023718 32315 log.cc:824] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:40.024482 32315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d: No bootstrap required, opened a new log
I20260811 11:09:40.026376 32315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33783 } }
I20260811 11:09:40.026531 32315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:40.026582 32315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a4b1db2addb4016a11a128b0ad63f9d, State: Initialized, Role: FOLLOWER
I20260811 11:09:40.026722 32315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33783 } }
I20260811 11:09:40.026822 32315 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:40.026868 32315 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:40.026917 32315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:40.027598 32315 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33783 } }
I20260811 11:09:40.027715 32315 leader_election.cc:302] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a4b1db2addb4016a11a128b0ad63f9d; no voters:
I20260811 11:09:40.027915 32315 leader_election.cc:288] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:40.027940 32323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:40.028057 32323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [term 1 LEADER]: Becoming Leader. State: Replica: 8a4b1db2addb4016a11a128b0ad63f9d, State: Running, Role: LEADER
I20260811 11:09:40.028132 32323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33783 } }
I20260811 11:09:40.028190 32315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:40.029949 32320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:40.023785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:49037 (local address 127.0.0.1:33783)
0811 11:09:40.023997 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:40.024006 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:40.024042 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:09:40.024605 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:40.024614 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:40.024690 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:40.024841 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:40.025080 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:40.026054 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:40.026978 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:40.027601 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:40.027728 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:40.029007 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:40.029012 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:40.029012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:40.029268 (+ 256us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:40.029311 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:40.029326 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:40.029406 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:40.029683 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 11:09:40.029713 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":99,"threads_started":1}
I20260811 11:09:40.031137 32324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33783 } } }
I20260811 11:09:40.031239 32324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:40.031517 32325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a4b1db2addb4016a11a128b0ad63f9d. Latest consensus state: current_term: 1 leader_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4b1db2addb4016a11a128b0ad63f9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33783 } } }
I20260811 11:09:40.031584 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:40.031663 32325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:40.031817 32332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:40.032337 32332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:40.034117 32332 catalog_manager.cc:1347] Generated new cluster ID: 991202ac63d24ba79c5bd3d73b0d421b
I20260811 11:09:40.034169 32332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:40.036939 32320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:40.033130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:52267 (local address 127.0.0.1:33783)
0811 11:09:40.033182 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:40.033184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:40.033370 (+ 186us) server_negotiation.cc:407] Connection header received
0811 11:09:40.033461 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:40.033462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:40.033472 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:40.033521 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:40.033716 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:40.034405 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:40.035504 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:40.035824 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:40.035868 (+ 44us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:40.036644 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:40.036645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:40.036646 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:40.036651 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:40.036664 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:40.036669 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:40.036706 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:40.036844 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 11:09:40.036855 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:09:40.051451 32332 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:40.051972 32332 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:40.064018 32332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a4b1db2addb4016a11a128b0ad63f9d: Generated new TSK 0
I20260811 11:09:40.064225 32332 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:40.073884 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32211
W20260811 11:09:40.088302 32177 connection.cc:535] client connection to 127.0.0.1:33783 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33783): Connection reset by peer (error 104)
2026-08-11T11:09:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:40 dist-test-slave-z8x9 krb5kdc[32361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:40 dist-test-slave-z8x9 krb5kdc[32361](info): set up 2 sockets
Aug 11 11:09:40 dist-test-slave-z8x9 krb5kdc[32361](info): commencing operation
krb5kdc: starting...
W20260811 11:09:41.380700 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:41 dist-test-slave-z8x9 krb5kdc[32361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:41.507275 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39199
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:41.592322 32385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:41.592525 32385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:41.592547 32385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:41.593621 32385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:41.593654 32385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:41.593669 32385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:41.593683 32385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:41.593694 32385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:41.595081 32385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:41.595270 32385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:41.595453 32385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:41.600481 32397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:41.600482 32393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:41.600488 32392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:41.600489 32385 server_base.cc:1034] running on GCE node
I20260811 11:09:41.600986 32385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:41.601342 32385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:41.602517 32385 hybrid_clock.cc:648] HybridClock initialized: now 1786446581602509 us; error 40 us; skew 500 ppm
Aug 11 11:09:41 dist-test-slave-z8x9 krb5kdc[32361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:41.604959 32385 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:41.605456 32385 webserver.cc:460] Webserver started at http://127.0.0.1:38275/ using document root <none> and password file <none>
I20260811 11:09:41.605712 32385 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:41.605782 32385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:41.605934 32385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:41.606981 32385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a"
format_stamp: "Formatted at 2026-08-11 11:09:41 on dist-test-slave-z8x9"
server_key: "957d853c5f8f32d9a54a4c9dca684e56"
server_key_iv: "0bc8066ea8f06bba58d10dffb7fd65f0"
server_key_version: "encryptionkey@0"
I20260811 11:09:41.607353 32385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a"
format_stamp: "Formatted at 2026-08-11 11:09:41 on dist-test-slave-z8x9"
server_key: "957d853c5f8f32d9a54a4c9dca684e56"
server_key_iv: "0bc8066ea8f06bba58d10dffb7fd65f0"
server_key_version: "encryptionkey@0"
I20260811 11:09:41.608783 32385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:09:41.609571 32409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:41.609754 32385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:41.609866 32385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a"
format_stamp: "Formatted at 2026-08-11 11:09:41 on dist-test-slave-z8x9"
server_key: "957d853c5f8f32d9a54a4c9dca684e56"
server_key_iv: "0bc8066ea8f06bba58d10dffb7fd65f0"
server_key_version: "encryptionkey@0"
I20260811 11:09:41.609941 32385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:41.613363 32385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:41.615341 32385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:41.615506 32385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:41.619779 32385 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39199
I20260811 11:09:41.619813 32496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39199 every 8 connection(s)
I20260811 11:09:41.620138 32385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:41.621215 32497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:41.621984 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32385
I20260811 11:09:41.622117 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:41.622313 26508 external_mini_cluster.cc:1428] Setting key bf57af1675a518f38f6066b7e042647c
I20260811 11:09:41.624454 32497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a: Bootstrap starting.
I20260811 11:09:41.624965 32504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:41.622847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:50875 (local address 127.0.0.1:39199)
0811 11:09:41.623043 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:41.623052 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:41.623084 (+ 32us) server_negotiation.cc:407] Connection header received
0811 11:09:41.623594 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:41.623604 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:41.623640 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:41.623791 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:41.624458 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:41.624462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:41.624462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:41.624467 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:41.624511 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:41.624526 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:41.624594 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:41.624707 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 11:09:41.624750 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260811 11:09:41.625275 32497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:41.625598 32497 log.cc:824] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:41.626021 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:41.626386 32497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a: No bootstrap required, opened a new log
I20260811 11:09:41.628480 32504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:41.627471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:37977 (local address 127.0.0.1:39199)
0811 11:09:41.627509 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:41.627510 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:41.627596 (+ 86us) server_negotiation.cc:407] Connection header received
0811 11:09:41.627662 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:41.627662 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:41.627666 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:41.627713 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:41.628262 (+ 549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:41.628263 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:41.628263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:41.628267 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:41.628279 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:41.628283 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:41.628326 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:41.628389 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 11:09:41.628398 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 11:09:41.628680 32497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39199 } }
I20260811 11:09:41.628852 32497 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:41.628903 32497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c8a4ab9ff5f4784ba8829e7c7ce1c0a, State: Initialized, Role: FOLLOWER
I20260811 11:09:41.629029 32497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39199 } }
I20260811 11:09:41.629122 32497 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:41.629256 32497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:41.629328 32497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:41.629856 32497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39199 } }
I20260811 11:09:41.629981 32497 leader_election.cc:302] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c8a4ab9ff5f4784ba8829e7c7ce1c0a; no voters:
I20260811 11:09:41.630151 32497 leader_election.cc:288] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:41.630226 32520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:41.630396 32520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [term 1 LEADER]: Becoming Leader. State: Replica: 2c8a4ab9ff5f4784ba8829e7c7ce1c0a, State: Running, Role: LEADER
I20260811 11:09:41.630422 32497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:41.630578 32520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39199 } }
I20260811 11:09:41.631155 32527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39199 } } }
I20260811 11:09:41.631261 32527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:41.631158 32530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c8a4ab9ff5f4784ba8829e7c7ce1c0a. Latest consensus state: current_term: 1 leader_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a4ab9ff5f4784ba8829e7c7ce1c0a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39199 } } }
I20260811 11:09:41.631479 32547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:41.631596 32530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:41.632038 32547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:41.633451 32547 catalog_manager.cc:1347] Generated new cluster ID: fb2730352c004948abd100645b92f885
I20260811 11:09:41.633510 32547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:41.650722 32547 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:41.650909 32547 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:41.657534 32547 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c8a4ab9ff5f4784ba8829e7c7ce1c0a: Generated new TSK 0
I20260811 11:09:41.657733 32547 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:41.659566 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32385
2026-08-11T11:09:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1585 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:41 dist-test-slave-z8x9 krb5kdc[32566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:41 dist-test-slave-z8x9 krb5kdc[32566](info): set up 2 sockets
Aug 11 11:09:41 dist-test-slave-z8x9 krb5kdc[32566](info): commencing operation
krb5kdc: starting...
W20260811 11:09:42.981581 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:43 dist-test-slave-z8x9 krb5kdc[32566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:43.106251 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43471
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:43.189646 32589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:43.189910 32589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:43.189949 32589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:43.191102 32589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:43.191174 32589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:43.191197 32589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:43.191219 32589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:43.191246 32589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:43.192785 32589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43471
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:43.193082 32589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:43.193351 32589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:09:43.198505 32589 server_base.cc:1034] running on GCE node
W20260811 11:09:43.198450 32602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:43.198450 32600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:43.198457 32599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:43.199041 32589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:43.199373 32589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:43.200528 32589 hybrid_clock.cc:648] HybridClock initialized: now 1786446583200513 us; error 32 us; skew 500 ppm
Aug 11 11:09:43 dist-test-slave-z8x9 krb5kdc[32566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446583, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:43.203307 32589 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:43.203776 32589 webserver.cc:460] Webserver started at http://127.0.0.1:42213/ using document root <none> and password file <none>
I20260811 11:09:43.204022 32589 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:43.204071 32589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:43.204210 32589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:43.205410 32589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "bc51b4bf910047a688c0a5534cca70d4"
format_stamp: "Formatted at 2026-08-11 11:09:43 on dist-test-slave-z8x9"
server_key: "81326a9d4ab4a8d8cb70b127b2454a53"
server_key_iv: "1ff864be8f9f9d6ffdc05468dd337dd5"
server_key_version: "encryptionkey@0"
I20260811 11:09:43.205776 32589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "bc51b4bf910047a688c0a5534cca70d4"
format_stamp: "Formatted at 2026-08-11 11:09:43 on dist-test-slave-z8x9"
server_key: "81326a9d4ab4a8d8cb70b127b2454a53"
server_key_iv: "1ff864be8f9f9d6ffdc05468dd337dd5"
server_key_version: "encryptionkey@0"
I20260811 11:09:43.207202 32589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:43.207998 32612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:43.208302 32589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:43.208401 32589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "bc51b4bf910047a688c0a5534cca70d4"
format_stamp: "Formatted at 2026-08-11 11:09:43 on dist-test-slave-z8x9"
server_key: "81326a9d4ab4a8d8cb70b127b2454a53"
server_key_iv: "1ff864be8f9f9d6ffdc05468dd337dd5"
server_key_version: "encryptionkey@0"
I20260811 11:09:43.208477 32589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:43.227120 32589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:43.229321 32589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:43.229497 32589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:43.233760 32589 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43471
I20260811 11:09:43.233834 32699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43471 every 8 connection(s)
I20260811 11:09:43.234187 32589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:43.235116 32700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:43.237732 32700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4: Bootstrap starting.
I20260811 11:09:43.238358 32700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:43.238677 32700 log.cc:824] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:43.239511 32700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4: No bootstrap required, opened a new log
I20260811 11:09:43.241148 32700 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc51b4bf910047a688c0a5534cca70d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43471 } }
I20260811 11:09:43.241319 32700 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:43.241343 32700 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc51b4bf910047a688c0a5534cca70d4, State: Initialized, Role: FOLLOWER
I20260811 11:09:43.241534 32700 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc51b4bf910047a688c0a5534cca70d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43471 } }
I20260811 11:09:43.241621 32700 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:43.241676 32700 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:43.241746 32700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:43.241782 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32589
I20260811 11:09:43.241931 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:43.242156 26508 external_mini_cluster.cc:1428] Setting key ab1840b7609e82f2e15a9b0d986f6079
I20260811 11:09:43.242441 32700 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc51b4bf910047a688c0a5534cca70d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43471 } }
I20260811 11:09:43.242563 32700 leader_election.cc:302] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc51b4bf910047a688c0a5534cca70d4; no voters:
I20260811 11:09:43.242769 32700 leader_election.cc:288] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:43.242808 32709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:43.243029 32709 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [term 1 LEADER]: Becoming Leader. State: Replica: bc51b4bf910047a688c0a5534cca70d4, State: Running, Role: LEADER
I20260811 11:09:43.243134 32700 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:43.243199 32709 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc51b4bf910047a688c0a5534cca70d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43471 } }
I20260811 11:09:43.243635 32710 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc51b4bf910047a688c0a5534cca70d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc51b4bf910047a688c0a5534cca70d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43471 } } }
I20260811 11:09:43.243717 32710 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:43.243778 32711 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc51b4bf910047a688c0a5534cca70d4. Latest consensus state: current_term: 1 leader_uuid: "bc51b4bf910047a688c0a5534cca70d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc51b4bf910047a688c0a5534cca70d4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43471 } } }
I20260811 11:09:43.243842 32711 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:43.244534 32716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:43.245075 32716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:43.246876 32716 catalog_manager.cc:1347] Generated new cluster ID: 754c7130677743b4b6b4b1caf896de84
I20260811 11:09:43.246933 32716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:09:43 dist-test-slave-z8x9 krb5kdc[32566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 11:09:43.254146 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:43.242651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:44849 (local address 127.0.0.1:43471)
0811 11:09:43.242871 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:43.242881 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:43.242919 (+ 38us) server_negotiation.cc:407] Connection header received
0811 11:09:43.243049 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:43.243056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:43.243116 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:43.244234 (+ 1118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:43.244383 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:43.245666 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:43.246576 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:43.247110 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:43.247533 (+ 423us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:43.250039 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:43.250043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:43.250043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:43.250056 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:43.252093 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:43.252533 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:43.252536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:43.252537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:43.252646 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:43.252865 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:43.252866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:43.252866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:43.253158 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:43.253731 (+ 573us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:43.253812 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 11:09:43.253909 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":88,"threads_started":1}
I20260811 11:09:43.255105 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:43.263922 32716 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:43.264436 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:43.256613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:46041 (local address 127.0.0.1:43471)
0811 11:09:43.256647 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:43.256649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:43.256771 (+ 122us) server_negotiation.cc:407] Connection header received
0811 11:09:43.256840 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:43.256841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:43.256851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:43.256906 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:43.257595 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:43.258323 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:43.259353 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:43.259664 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:43.259730 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:43.261185 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:43.261187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:43.261187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:43.261195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:43.262781 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:43.263223 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:43.263225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:43.263225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:43.263287 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:43.263559 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:43.263560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:43.263561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:43.263688 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:43.263824 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:43.264280 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 11:09:43.264346 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 11:09:43.264595 32716 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:43.280653 32716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc51b4bf910047a688c0a5534cca70d4: Generated new TSK 0
I20260811 11:09:43.280902 32716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:43.283318 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32589
W20260811 11:09:43.297506 32561 connection.cc:535] client connection to 127.0.0.1:43471 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43471): Connection reset by peer (error 104)
2026-08-11T11:09:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1622 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:43 dist-test-slave-z8x9 krb5kdc[32747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:43 dist-test-slave-z8x9 krb5kdc[32747](info): set up 2 sockets
Aug 11 11:09:43 dist-test-slave-z8x9 krb5kdc[32747](info): commencing operation
krb5kdc: starting...
W20260811 11:09:44.583159 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:44 dist-test-slave-z8x9 krb5kdc[32747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:44.706032 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38387
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:44.788487 32765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:44.788700 32765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:44.788723 32765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:44.789916 32765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:44.789963 32765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:44.789978 32765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:44.790033 32765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:44.790060 32765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:44.791599 32765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38387
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:44.791877 32765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:44.792114 32765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:44.797232 308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:44.797278 313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:44.797251 309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:44.797323 32765 server_base.cc:1034] running on GCE node
I20260811 11:09:44.797756 32765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:44.798062 32765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:44.799220 32765 hybrid_clock.cc:648] HybridClock initialized: now 1786446584799197 us; error 37 us; skew 500 ppm
Aug 11 11:09:44 dist-test-slave-z8x9 krb5kdc[32747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446584, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:44.801806 32765 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:44.802286 32765 webserver.cc:460] Webserver started at http://127.0.0.1:38429/ using document root <none> and password file <none>
I20260811 11:09:44.802536 32765 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:44.802584 32765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:44.802728 32765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:44.804100 32765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "76b9002dd4404ad79f86b11833e65c05"
format_stamp: "Formatted at 2026-08-11 11:09:44 on dist-test-slave-z8x9"
server_key: "f85c2e351afc2b38dd8e997437ad119f"
server_key_iv: "daee2692e16cabacc0afe7722ae85fdf"
server_key_version: "encryptionkey@0"
I20260811 11:09:44.804615 32765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "76b9002dd4404ad79f86b11833e65c05"
format_stamp: "Formatted at 2026-08-11 11:09:44 on dist-test-slave-z8x9"
server_key: "f85c2e351afc2b38dd8e997437ad119f"
server_key_iv: "daee2692e16cabacc0afe7722ae85fdf"
server_key_version: "encryptionkey@0"
I20260811 11:09:44.806118 32765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 11:09:44.806897 320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:44.807094 32765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:09:44.807204 32765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "76b9002dd4404ad79f86b11833e65c05"
format_stamp: "Formatted at 2026-08-11 11:09:44 on dist-test-slave-z8x9"
server_key: "f85c2e351afc2b38dd8e997437ad119f"
server_key_iv: "daee2692e16cabacc0afe7722ae85fdf"
server_key_version: "encryptionkey@0"
I20260811 11:09:44.807301 32765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:44.819494 32765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:44.821619 32765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:44.821794 32765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:44.825873 32765 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38387
I20260811 11:09:44.825951 416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38387 every 8 connection(s)
I20260811 11:09:44.826306 32765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:44.827296 417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:44.829738 417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05: Bootstrap starting.
I20260811 11:09:44.830338 417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:44.830646 417 log.cc:824] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:44.830911 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 32765
I20260811 11:09:44.831080 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:44.831318 26508 external_mini_cluster.cc:1428] Setting key d276041f30d60112f7a4b35e1d873bb5
I20260811 11:09:44.831578 417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05: No bootstrap required, opened a new log
I20260811 11:09:44.833431 417 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b9002dd4404ad79f86b11833e65c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38387 } }
I20260811 11:09:44.833565 417 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:44.833588 417 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b9002dd4404ad79f86b11833e65c05, State: Initialized, Role: FOLLOWER
I20260811 11:09:44.833755 417 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b9002dd4404ad79f86b11833e65c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38387 } }
I20260811 11:09:44.833846 417 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:44.833897 417 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:44.833973 417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:44.834537 417 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b9002dd4404ad79f86b11833e65c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38387 } }
I20260811 11:09:44.834657 417 leader_election.cc:302] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76b9002dd4404ad79f86b11833e65c05; no voters:
I20260811 11:09:44.834861 417 leader_election.cc:288] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:44.834921 427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:44.835071 427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [term 1 LEADER]: Becoming Leader. State: Replica: 76b9002dd4404ad79f86b11833e65c05, State: Running, Role: LEADER
I20260811 11:09:44.835139 417 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:44.835216 427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b9002dd4404ad79f86b11833e65c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38387 } }
I20260811 11:09:44.835678 427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76b9002dd4404ad79f86b11833e65c05. Latest consensus state: current_term: 1 leader_uuid: "76b9002dd4404ad79f86b11833e65c05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b9002dd4404ad79f86b11833e65c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38387 } } }
I20260811 11:09:44.835814 427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:44.835776 429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76b9002dd4404ad79f86b11833e65c05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b9002dd4404ad79f86b11833e65c05" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38387 } } }
I20260811 11:09:44.835918 429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:44.836211 441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:44.837014 441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:44.838996 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:44.831836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:59739 (local address 127.0.0.1:38387)
0811 11:09:44.832040 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:44.832049 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:44.832080 (+ 31us) server_negotiation.cc:407] Connection header received
0811 11:09:44.833420 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:44.833429 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:44.833486 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:44.833661 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:44.834002 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:44.835566 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:44.836683 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:44.837352 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:44.837473 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:44.838227 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:44.838230 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:44.838231 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:44.838454 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:44.838494 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:44.838510 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:44.838601 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:44.838751 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 11:09:44.838780 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":83,"threads_started":1}
I20260811 11:09:44.839130 441 catalog_manager.cc:1347] Generated new cluster ID: e8b8f7fb7d7f4b1987f90082bb632905
I20260811 11:09:44.839162 441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:44.840003 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:44.844695 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:44.841461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:52283 (local address 127.0.0.1:38387)
0811 11:09:44.841499 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:44.841501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:44.841782 (+ 281us) server_negotiation.cc:407] Connection header received
0811 11:09:44.841858 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:44.841859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:44.841871 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:44.841927 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:44.842080 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:44.842562 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:44.843466 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:44.843691 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:44.843766 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:44.844453 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:44.844454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:44.844455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:44.844460 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:44.844473 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:44.844478 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:44.844532 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:44.844593 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 11:09:44.844604 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:09:44.846223 441 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:44.846999 441 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:44.856796 441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76b9002dd4404ad79f86b11833e65c05: Generated new TSK 0
I20260811 11:09:44.856967 441 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:44.863519 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 32765
W20260811 11:09:44.878036 32745 connection.cc:535] client connection to 127.0.0.1:38387 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38387): Connection reset by peer (error 104)
2026-08-11T11:09:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:44 dist-test-slave-z8x9 krb5kdc[474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:44 dist-test-slave-z8x9 krb5kdc[474](info): set up 2 sockets
Aug 11 11:09:44 dist-test-slave-z8x9 krb5kdc[474](info): commencing operation
krb5kdc: starting...
W20260811 11:09:46.166896 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:46 dist-test-slave-z8x9 krb5kdc[474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 11:09:46.287904 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43559
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:46.370527 493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:46.370741 493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:46.370765 493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:46.371850 493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:46.371884 493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:46.371898 493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:46.371912 493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:46.371923 493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:46.373364 493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43559
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:46.373558 493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:46.373725 493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:46.378718 501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:46.378707 500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:46.378711 506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:46.379055 493 server_base.cc:1034] running on GCE node
I20260811 11:09:46.379362 493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:46.379701 493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:46.380878 493 hybrid_clock.cc:648] HybridClock initialized: now 1786446586380865 us; error 48 us; skew 500 ppm
Aug 11 11:09:46 dist-test-slave-z8x9 krb5kdc[474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446586, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:46.389752 493 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 11:09:46.390254 493 webserver.cc:460] Webserver started at http://127.0.0.1:36257/ using document root <none> and password file <none>
I20260811 11:09:46.390509 493 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:46.390583 493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:46.390738 493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:46.391908 493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "3f162612b4d8454f93ce422aa28327c9"
format_stamp: "Formatted at 2026-08-11 11:09:46 on dist-test-slave-z8x9"
server_key: "405f9cf89a838528363dfc68c89d4048"
server_key_iv: "fde53d4b803969e2c118b72c62cf9a3e"
server_key_version: "encryptionkey@0"
I20260811 11:09:46.392297 493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "3f162612b4d8454f93ce422aa28327c9"
format_stamp: "Formatted at 2026-08-11 11:09:46 on dist-test-slave-z8x9"
server_key: "405f9cf89a838528363dfc68c89d4048"
server_key_iv: "fde53d4b803969e2c118b72c62cf9a3e"
server_key_version: "encryptionkey@0"
I20260811 11:09:46.393810 493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:46.394577 517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:46.394759 493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:46.394872 493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "3f162612b4d8454f93ce422aa28327c9"
format_stamp: "Formatted at 2026-08-11 11:09:46 on dist-test-slave-z8x9"
server_key: "405f9cf89a838528363dfc68c89d4048"
server_key_iv: "fde53d4b803969e2c118b72c62cf9a3e"
server_key_version: "encryptionkey@0"
I20260811 11:09:46.394949 493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:46.398434 493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:46.400813 493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:46.400974 493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:46.405265 493 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43559
I20260811 11:09:46.405296 610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43559 every 8 connection(s)
I20260811 11:09:46.405663 493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:46.406634 611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:46.408989 611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9: Bootstrap starting.
I20260811 11:09:46.409714 611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:46.410017 611 log.cc:824] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:46.410818 611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9: No bootstrap required, opened a new log
I20260811 11:09:46.412510 611 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f162612b4d8454f93ce422aa28327c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43559 } }
I20260811 11:09:46.412657 611 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:46.412680 611 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f162612b4d8454f93ce422aa28327c9, State: Initialized, Role: FOLLOWER
I20260811 11:09:46.412854 611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f162612b4d8454f93ce422aa28327c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43559 } }
I20260811 11:09:46.412925 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 493
I20260811 11:09:46.412955 611 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:46.412992 611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:46.413038 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:46.413048 611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:46.413290 26508 external_mini_cluster.cc:1428] Setting key 6a75b6d2b0a9af021c17d642e2b76a62
I20260811 11:09:46.413852 611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f162612b4d8454f93ce422aa28327c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43559 } }
I20260811 11:09:46.413976 611 leader_election.cc:302] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f162612b4d8454f93ce422aa28327c9; no voters:
I20260811 11:09:46.414189 611 leader_election.cc:288] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:46.414213 617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:46.414330 617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [term 1 LEADER]: Becoming Leader. State: Replica: 3f162612b4d8454f93ce422aa28327c9, State: Running, Role: LEADER
I20260811 11:09:46.414439 617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f162612b4d8454f93ce422aa28327c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43559 } }
I20260811 11:09:46.414479 611 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:46.414866 617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f162612b4d8454f93ce422aa28327c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f162612b4d8454f93ce422aa28327c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43559 } } }
I20260811 11:09:46.414943 617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:46.415176 619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f162612b4d8454f93ce422aa28327c9. Latest consensus state: current_term: 1 leader_uuid: "3f162612b4d8454f93ce422aa28327c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f162612b4d8454f93ce422aa28327c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43559 } } }
I20260811 11:09:46.415320 619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:46.415350 628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:46.416004 628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:46.416617 616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:46.413828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:47605 (local address 127.0.0.1:43559)
0811 11:09:46.414075 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:46.414085 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:46.414119 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:09:46.414232 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:46.414239 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:46.414293 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:46.414480 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:46.415911 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:46.415916 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:46.415917 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:46.415923 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:46.415974 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:46.415991 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:46.416054 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:46.416379 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 11:09:46.416425 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":118,"threads_started":1}
I20260811 11:09:46.417671 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:46.417691 628 catalog_manager.cc:1347] Generated new cluster ID: 626e20830b9b4ab0a922f171fdf7775b
I20260811 11:09:46.417739 628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:46.420424 616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:46.419312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.69:58583 (local address 127.0.0.1:43559)
0811 11:09:46.419354 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:46.419356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:46.419482 (+ 126us) server_negotiation.cc:407] Connection header received
0811 11:09:46.419526 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:46.419527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:46.419533 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:46.419601 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:46.420188 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:46.420190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:46.420190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:46.420194 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:46.420213 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:46.420226 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:46.420289 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:46.420342 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 11:09:46.420354 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:09:46.452337 628 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:46.452579 628 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:46.461316 628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f162612b4d8454f93ce422aa28327c9: Generated new TSK 0
I20260811 11:09:46.461553 628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:46.473268 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 493
2026-08-11T11:09:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1610 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:46 dist-test-slave-z8x9 krb5kdc[666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:46 dist-test-slave-z8x9 krb5kdc[666](info): set up 2 sockets
Aug 11 11:09:46 dist-test-slave-z8x9 krb5kdc[666](info): commencing operation
krb5kdc: starting...
W20260811 11:09:47.836000 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:47 dist-test-slave-z8x9 krb5kdc[666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:47.960353 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42441
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:48.043409 687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:48.043656 687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:48.043695 687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:48.044858 687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:48.044929 687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:48.044956 687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:48.044988 687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:48.045012 687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:48.046561 687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:42441
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:48.046845 687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:48.047078 687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:48.052096 698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:48.052145 687 server_base.cc:1034] running on GCE node
W20260811 11:09:48.052115 700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:48.052115 695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:48.052567 687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:48.052860 687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:48.054028 687 hybrid_clock.cc:648] HybridClock initialized: now 1786446588054022 us; error 38 us; skew 500 ppm
Aug 11 11:09:48 dist-test-slave-z8x9 krb5kdc[666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446588, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:48.056670 687 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:48.057150 687 webserver.cc:460] Webserver started at http://127.25.227.62:35271/ using document root <none> and password file <none>
I20260811 11:09:48.057456 687 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:48.057526 687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:48.057682 687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:48.058717 687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "109f1a0deac44c8c89e2f061fad8a8a3"
format_stamp: "Formatted at 2026-08-11 11:09:48 on dist-test-slave-z8x9"
server_key: "a1f9c61b88ce84cfd7f4efe630e02993"
server_key_iv: "d2bd3acbeb9c6c17c1da75a64158314c"
server_key_version: "encryptionkey@0"
I20260811 11:09:48.059080 687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "109f1a0deac44c8c89e2f061fad8a8a3"
format_stamp: "Formatted at 2026-08-11 11:09:48 on dist-test-slave-z8x9"
server_key: "a1f9c61b88ce84cfd7f4efe630e02993"
server_key_iv: "d2bd3acbeb9c6c17c1da75a64158314c"
server_key_version: "encryptionkey@0"
I20260811 11:09:48.060388 687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:48.061103 718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:48.061304 687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:48.061407 687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "109f1a0deac44c8c89e2f061fad8a8a3"
format_stamp: "Formatted at 2026-08-11 11:09:48 on dist-test-slave-z8x9"
server_key: "a1f9c61b88ce84cfd7f4efe630e02993"
server_key_iv: "d2bd3acbeb9c6c17c1da75a64158314c"
server_key_version: "encryptionkey@0"
I20260811 11:09:48.061492 687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:48.099181 687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:48.101766 687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:48.101934 687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:48.105896 687 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:42441
I20260811 11:09:48.106031 797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:42441 every 8 connection(s)
I20260811 11:09:48.106340 687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:48.107328 798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:48.109724 798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3: Bootstrap starting.
I20260811 11:09:48.110316 798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:48.110610 798 log.cc:824] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:48.111346 798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3: No bootstrap required, opened a new log
I20260811 11:09:48.113150 798 raft_consensus.cc:348] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42441 } }
I20260811 11:09:48.113373 798 raft_consensus.cc:374] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:48.113417 798 raft_consensus.cc:729] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 109f1a0deac44c8c89e2f061fad8a8a3, State: Initialized, Role: FOLLOWER
I20260811 11:09:48.113567 798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42441 } }
I20260811 11:09:48.113636 798 raft_consensus.cc:388] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:48.113695 798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:48.113760 798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:48.114653 798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42441 } }
I20260811 11:09:48.114770 798 leader_election.cc:302] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 109f1a0deac44c8c89e2f061fad8a8a3; no voters:
I20260811 11:09:48.114957 798 leader_election.cc:288] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:48.114979 804 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:48.115157 804 raft_consensus.cc:686] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [term 1 LEADER]: Becoming Leader. State: Replica: 109f1a0deac44c8c89e2f061fad8a8a3, State: Running, Role: LEADER
I20260811 11:09:48.115269 798 sys_catalog.cc:564] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:48.115319 804 consensus_queue.cc:237] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42441 } }
I20260811 11:09:48.115717 807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42441 } } }
I20260811 11:09:48.115724 809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 109f1a0deac44c8c89e2f061fad8a8a3. Latest consensus state: current_term: 1 leader_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "109f1a0deac44c8c89e2f061fad8a8a3" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42441 } } }
I20260811 11:09:48.115826 807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:48.116134 809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:48.116214 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 687
I20260811 11:09:48.116321 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:48.116387 822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:48.116518 26508 external_mini_cluster.cc:1428] Setting key 8bd3ec31a2e4aee5fddec5cc1aca03b9
I20260811 11:09:48.116930 822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:48.119026 822 catalog_manager.cc:1347] Generated new cluster ID: 1cc5e7d3a69d4c7e9dba4d5109849028
I20260811 11:09:48.119091 822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 11:09:48 dist-test-slave-z8x9 krb5kdc[666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:48.129040 842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:48.117016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40653 (local address 127.25.227.62:42441)
0811 11:09:48.117225 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:48.117234 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:48.117557 (+ 323us) server_negotiation.cc:407] Connection header received
0811 11:09:48.117718 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:48.117724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:48.117770 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:48.117909 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:48.118556 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:48.119944 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:48.121294 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:48.121926 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:48.122023 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:48.125089 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:48.125094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:48.125094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:48.125107 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:48.127153 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:48.127624 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:48.127628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:48.127628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:48.127789 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:48.128055 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:48.128056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:48.128056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:48.128362 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:48.128530 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:48.128661 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 11:09:48.128774 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":100,"threads_started":1}
I20260811 11:09:48.129129 822 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:48.129844 822 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:48.130270 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:48.139139 842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:48.131672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52765 (local address 127.25.227.62:42441)
0811 11:09:48.131732 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:48.131734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:48.131960 (+ 226us) server_negotiation.cc:407] Connection header received
0811 11:09:48.132002 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:48.132003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:48.132013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:48.132064 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:48.132666 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:48.133530 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:48.134514 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:48.134841 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:48.134912 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:48.136250 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:48.136251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:48.136252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:48.136259 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:48.137899 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:48.138313 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:48.138315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:48.138315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:48.138379 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:48.138612 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:48.138613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:48.138614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:48.138750 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:48.138864 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:48.138982 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:09:48.139048 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:09:48.140537 822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 109f1a0deac44c8c89e2f061fad8a8a3: Generated new TSK 0
I20260811 11:09:48.140686 822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:48.143781 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 687
W20260811 11:09:48.158914 663 connection.cc:535] client connection to 127.25.227.62:42441 recv error: Network error: failed to read from TLS socket (remote: 127.25.227.62:42441): Connection reset by peer (error 104)
2026-08-11T11:09:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1669 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:48 dist-test-slave-z8x9 krb5kdc[854](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:48 dist-test-slave-z8x9 krb5kdc[854](info): set up 2 sockets
Aug 11 11:09:48 dist-test-slave-z8x9 krb5kdc[854](info): commencing operation
krb5kdc: starting...
W20260811 11:09:49.439009 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:49 dist-test-slave-z8x9 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:49.564014 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42069
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:42069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:49.647980 871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:49.648223 871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:49.648264 871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:49.649396 871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:49.649469 871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:49.649493 871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:49.649516 871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:49.649544 871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:49.651005 871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:42069
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:42069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:49.651278 871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:49.651515 871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:49.656343 880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:49.656353 879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:49.656368 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:49.656659 871 server_base.cc:1034] running on GCE node
I20260811 11:09:49.657004 871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:49.657385 871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:49.658561 871 hybrid_clock.cc:648] HybridClock initialized: now 1786446589658553 us; error 36 us; skew 500 ppm
Aug 11 11:09:49 dist-test-slave-z8x9 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446589, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:49.661381 871 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:49.661816 871 webserver.cc:460] Webserver started at http://127.25.227.62:42519/ using document root <none> and password file <none>
I20260811 11:09:49.662046 871 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:49.662114 871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:49.662259 871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:49.663336 871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "df78c5431a49475ab4bec41d69d8ef86"
format_stamp: "Formatted at 2026-08-11 11:09:49 on dist-test-slave-z8x9"
server_key: "7d00053f4ef782e1516724183b7816e2"
server_key_iv: "ee220fd0aa73828c5f2e93bb84a4afe6"
server_key_version: "encryptionkey@0"
I20260811 11:09:49.663722 871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "df78c5431a49475ab4bec41d69d8ef86"
format_stamp: "Formatted at 2026-08-11 11:09:49 on dist-test-slave-z8x9"
server_key: "7d00053f4ef782e1516724183b7816e2"
server_key_iv: "ee220fd0aa73828c5f2e93bb84a4afe6"
server_key_version: "encryptionkey@0"
I20260811 11:09:49.665525 871 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 11:09:49.666355 892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:49.666549 871 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:49.666646 871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "df78c5431a49475ab4bec41d69d8ef86"
format_stamp: "Formatted at 2026-08-11 11:09:49 on dist-test-slave-z8x9"
server_key: "7d00053f4ef782e1516724183b7816e2"
server_key_iv: "ee220fd0aa73828c5f2e93bb84a4afe6"
server_key_version: "encryptionkey@0"
I20260811 11:09:49.666720 871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:49.679996 871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:49.682344 871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:49.682456 871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:49.686910 871 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:42069
I20260811 11:09:49.686944 983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:42069 every 8 connection(s)
I20260811 11:09:49.687294 871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:49.688198 984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:49.690250 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 871
I20260811 11:09:49.690388 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:49.690557 26508 external_mini_cluster.cc:1428] Setting key 572a2f1564dda8cb7b4d0e3211523cc8
I20260811 11:09:49.690887 984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86: Bootstrap starting.
I20260811 11:09:49.691632 984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:49.691941 984 log.cc:824] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:49.692651 984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86: No bootstrap required, opened a new log
I20260811 11:09:49.694512 984 raft_consensus.cc:348] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df78c5431a49475ab4bec41d69d8ef86" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42069 } }
I20260811 11:09:49.694669 984 raft_consensus.cc:374] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:49.694734 984 raft_consensus.cc:729] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df78c5431a49475ab4bec41d69d8ef86, State: Initialized, Role: FOLLOWER
I20260811 11:09:49.694911 984 consensus_queue.cc:260] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df78c5431a49475ab4bec41d69d8ef86" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42069 } }
I20260811 11:09:49.695007 984 raft_consensus.cc:388] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:49.695052 984 raft_consensus.cc:482] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:49.695104 984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:49.695756 984 raft_consensus.cc:504] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df78c5431a49475ab4bec41d69d8ef86" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42069 } }
I20260811 11:09:49.695876 984 leader_election.cc:302] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df78c5431a49475ab4bec41d69d8ef86; no voters:
I20260811 11:09:49.696050 984 leader_election.cc:288] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:49.696105 991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:49.696138 988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:49.691169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58061 (local address 127.25.227.62:42069)
0811 11:09:49.691364 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:49.691372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:49.691397 (+ 25us) server_negotiation.cc:407] Connection header received
0811 11:09:49.691868 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:49.691875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:49.691923 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:49.692068 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:49.692322 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:49.693315 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:49.694108 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:49.694520 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:49.694645 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:49.695391 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:49.695395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:49.695396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:49.695559 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:49.695590 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:49.695601 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:49.695674 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:49.695817 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 11:09:49.695862 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":105,"threads_started":1}
I20260811 11:09:49.696306 984 sys_catalog.cc:564] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:49.696288 991 raft_consensus.cc:686] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [term 1 LEADER]: Becoming Leader. State: Replica: df78c5431a49475ab4bec41d69d8ef86, State: Running, Role: LEADER
I20260811 11:09:49.696651 991 consensus_queue.cc:237] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df78c5431a49475ab4bec41d69d8ef86" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42069 } }
I20260811 11:09:49.697325 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:49.697507 992 sys_catalog.cc:455] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df78c5431a49475ab4bec41d69d8ef86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df78c5431a49475ab4bec41d69d8ef86" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42069 } } }
I20260811 11:09:49.697594 992 sys_catalog.cc:458] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:49.698028 993 sys_catalog.cc:455] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df78c5431a49475ab4bec41d69d8ef86. Latest consensus state: current_term: 1 leader_uuid: "df78c5431a49475ab4bec41d69d8ef86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df78c5431a49475ab4bec41d69d8ef86" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 42069 } } }
I20260811 11:09:49.698122 993 sys_catalog.cc:458] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86 [sys.catalog]: This master's current role is: LEADER
W20260811 11:09:49.698303 1019 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:09:49.698354 1019 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:09:49.698431 1018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:49.698624 1018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:49.700105 1018 catalog_manager.cc:1347] Generated new cluster ID: 5023a96fb2064b0180ecf2a1ee03d706
I20260811 11:09:49.700162 1018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:49.702335 988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:49.698995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45209 (local address 127.25.227.62:42069)
0811 11:09:49.699034 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:49.699036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:49.699128 (+ 92us) server_negotiation.cc:407] Connection header received
0811 11:09:49.699197 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:49.699198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:49.699208 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:49.699273 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:49.699721 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:49.700329 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:49.701042 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:49.701366 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:49.701444 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:49.702059 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:49.702061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:49.702061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:49.702065 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:49.702079 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:49.702084 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:49.702142 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:49.702245 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 11:09:49.702262 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:09:49.707384 1018 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:49.708065 1018 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:49.711817 1018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df78c5431a49475ab4bec41d69d8ef86: Generated new TSK 0
I20260811 11:09:49.711977 1018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:49.717129 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 871
W20260811 11:09:49.730796 850 connection.cc:535] client connection to 127.25.227.62:42069 recv error: Network error: failed to read from TLS socket (remote: 127.25.227.62:42069): Connection reset by peer (error 104)
2026-08-11T11:09:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:49 dist-test-slave-z8x9 krb5kdc[1034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:49 dist-test-slave-z8x9 krb5kdc[1034](info): set up 2 sockets
Aug 11 11:09:49 dist-test-slave-z8x9 krb5kdc[1034](info): commencing operation
krb5kdc: starting...
W20260811 11:09:51.025725 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:51 dist-test-slave-z8x9 krb5kdc[1034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:51.148612 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:34585
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:34435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:34585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:51.233023 1051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:51.233338 1051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:51.233371 1051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:51.234627 1051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:51.234673 1051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:51.234688 1051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:51.234728 1051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:51.234757 1051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:51.236238 1051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:34435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:34585
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:34585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:51.236521 1051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:51.236779 1051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:51.242260 1057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:51.242344 1051 server_base.cc:1034] running on GCE node
W20260811 11:09:51.242255 1059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:51.242300 1061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:51.242873 1051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:51.243175 1051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:51.244359 1051 hybrid_clock.cc:648] HybridClock initialized: now 1786446591244338 us; error 39 us; skew 500 ppm
Aug 11 11:09:51 dist-test-slave-z8x9 krb5kdc[1034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446591, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:51.246953 1051 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:51.247440 1051 webserver.cc:460] Webserver started at http://127.25.227.62:37169/ using document root <none> and password file <none>
I20260811 11:09:51.247670 1051 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:51.247748 1051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:51.247901 1051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:51.248968 1051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "8327845b11d44e7bbeb03f21b504321a"
format_stamp: "Formatted at 2026-08-11 11:09:51 on dist-test-slave-z8x9"
server_key: "5796e96beb8408b445a723dbc5b7c095"
server_key_iv: "9348c077e447bfc62c74af8e373dfa1c"
server_key_version: "encryptionkey@0"
I20260811 11:09:51.249378 1051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "8327845b11d44e7bbeb03f21b504321a"
format_stamp: "Formatted at 2026-08-11 11:09:51 on dist-test-slave-z8x9"
server_key: "5796e96beb8408b445a723dbc5b7c095"
server_key_iv: "9348c077e447bfc62c74af8e373dfa1c"
server_key_version: "encryptionkey@0"
I20260811 11:09:51.250771 1051 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:51.251488 1073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:51.251664 1051 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:51.251792 1051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "8327845b11d44e7bbeb03f21b504321a"
format_stamp: "Formatted at 2026-08-11 11:09:51 on dist-test-slave-z8x9"
server_key: "5796e96beb8408b445a723dbc5b7c095"
server_key_iv: "9348c077e447bfc62c74af8e373dfa1c"
server_key_version: "encryptionkey@0"
I20260811 11:09:51.251868 1051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:51.255311 1051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:51.257216 1051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:51.257385 1051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:51.261668 1051 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:34585
I20260811 11:09:51.261698 1165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:34585 every 8 connection(s)
I20260811 11:09:51.262024 1051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:51.262997 1167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:51.264187 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1051
I20260811 11:09:51.264288 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:51.264496 26508 external_mini_cluster.cc:1428] Setting key 7dbcc341c1ae229e6f8d09f1ef9deabf
I20260811 11:09:51.265786 1167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a: Bootstrap starting.
I20260811 11:09:51.266544 1167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:51.266912 1167 log.cc:824] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:51.267225 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:51.265059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59701 (local address 127.25.227.62:34585)
0811 11:09:51.265290 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:51.265301 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:51.265338 (+ 37us) server_negotiation.cc:407] Connection header received
0811 11:09:51.265898 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:51.265907 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:51.265952 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:51.266100 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:51.266788 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:51.266792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:51.266792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:51.266797 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:51.266842 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:51.266857 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:51.266957 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:51.266990 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 11:09:51.267030 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":83,"threads_started":1}
I20260811 11:09:51.267767 1167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a: No bootstrap required, opened a new log
I20260811 11:09:51.268167 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:51.269986 1167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8327845b11d44e7bbeb03f21b504321a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34585 } }
I20260811 11:09:51.270124 1167 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:51.270190 1167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8327845b11d44e7bbeb03f21b504321a, State: Initialized, Role: FOLLOWER
I20260811 11:09:51.270315 1167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8327845b11d44e7bbeb03f21b504321a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34585 } }
I20260811 11:09:51.270421 1167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:51.270511 1167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:51.270601 1167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:51.270797 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:51.269640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55863 (local address 127.25.227.62:34585)
0811 11:09:51.269693 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:51.269695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:51.269816 (+ 121us) server_negotiation.cc:407] Connection header received
0811 11:09:51.269895 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:51.269896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:51.269901 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:51.269971 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:51.270573 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:51.270574 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:51.270574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:51.270579 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:51.270591 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:51.270595 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:51.270654 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:51.270711 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 11:09:51.270731 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:09:51.271309 1167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8327845b11d44e7bbeb03f21b504321a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34585 } }
I20260811 11:09:51.271422 1167 leader_election.cc:302] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8327845b11d44e7bbeb03f21b504321a; no voters:
I20260811 11:09:51.271593 1167 leader_election.cc:288] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:51.271636 1188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:51.271806 1188 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [term 1 LEADER]: Becoming Leader. State: Replica: 8327845b11d44e7bbeb03f21b504321a, State: Running, Role: LEADER
I20260811 11:09:51.271879 1167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:51.271940 1188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8327845b11d44e7bbeb03f21b504321a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34585 } }
I20260811 11:09:51.272341 1189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8327845b11d44e7bbeb03f21b504321a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8327845b11d44e7bbeb03f21b504321a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34585 } } }
I20260811 11:09:51.272634 1189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:51.272552 1190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8327845b11d44e7bbeb03f21b504321a. Latest consensus state: current_term: 1 leader_uuid: "8327845b11d44e7bbeb03f21b504321a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8327845b11d44e7bbeb03f21b504321a" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 34585 } } }
I20260811 11:09:51.272820 1190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:51.273022 1202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:51.273561 1202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:51.275130 1202 catalog_manager.cc:1347] Generated new cluster ID: f1897e37b233491591e87ad8a8e7496a
I20260811 11:09:51.275193 1202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:51.279893 1202 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:51.280061 1202 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:51.282373 1202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8327845b11d44e7bbeb03f21b504321a: Generated new TSK 0
I20260811 11:09:51.282544 1202 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:51.284897 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1051
2026-08-11T11:09:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:51 dist-test-slave-z8x9 krb5kdc[1222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:51 dist-test-slave-z8x9 krb5kdc[1222](info): set up 2 sockets
Aug 11 11:09:51 dist-test-slave-z8x9 krb5kdc[1222](info): commencing operation
krb5kdc: starting...
W20260811 11:09:52.577018 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:52 dist-test-slave-z8x9 krb5kdc[1222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:52.701913 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43291
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:35291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:43291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:52.785060 1238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:52.785295 1238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:52.785318 1238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:52.786379 1238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:52.786415 1238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:52.786429 1238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:52.786441 1238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:52.786453 1238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:52.787945 1238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:35291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:43291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:43291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:52.788205 1238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:52.788434 1238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:52.793507 1248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:52.793519 1251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:52.793531 1246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:52.793550 1238 server_base.cc:1034] running on GCE node
I20260811 11:09:52.793964 1238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:52.794281 1238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:52.795426 1238 hybrid_clock.cc:648] HybridClock initialized: now 1786446592795407 us; error 36 us; skew 500 ppm
Aug 11 11:09:52 dist-test-slave-z8x9 krb5kdc[1222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446592, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:52.802284 1238 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:52.802767 1238 webserver.cc:460] Webserver started at http://127.25.227.62:33611/ using document root <none> and password file <none>
I20260811 11:09:52.802974 1238 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:52.803014 1238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:52.803102 1238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:52.804122 1238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "16faf470a9a3488f9f2304f0b593c7f5"
format_stamp: "Formatted at 2026-08-11 11:09:52 on dist-test-slave-z8x9"
server_key: "a153a416965c78f2cc943e8ac71b38f9"
server_key_iv: "d0cd9a439007f5d11c8c62ebe4582f0b"
server_key_version: "encryptionkey@0"
I20260811 11:09:52.804437 1238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "16faf470a9a3488f9f2304f0b593c7f5"
format_stamp: "Formatted at 2026-08-11 11:09:52 on dist-test-slave-z8x9"
server_key: "a153a416965c78f2cc943e8ac71b38f9"
server_key_iv: "d0cd9a439007f5d11c8c62ebe4582f0b"
server_key_version: "encryptionkey@0"
I20260811 11:09:52.805830 1238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:52.806532 1265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:52.806713 1238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:09:52.806829 1238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "16faf470a9a3488f9f2304f0b593c7f5"
format_stamp: "Formatted at 2026-08-11 11:09:52 on dist-test-slave-z8x9"
server_key: "a153a416965c78f2cc943e8ac71b38f9"
server_key_iv: "d0cd9a439007f5d11c8c62ebe4582f0b"
server_key_version: "encryptionkey@0"
I20260811 11:09:52.806906 1238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:52.828855 1238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:52.830916 1238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:52.831091 1238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:52.835321 1238 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:43291
I20260811 11:09:52.835358 1342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:43291 every 8 connection(s)
I20260811 11:09:52.835733 1238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:52.836628 1344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:52.837321 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1238
I20260811 11:09:52.837440 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:52.837627 26508 external_mini_cluster.cc:1428] Setting key 8b798e3cbc7652d8e6be14a0ed3112d3
I20260811 11:09:52.839803 1344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5: Bootstrap starting.
I20260811 11:09:52.840509 1344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:52.840827 1344 log.cc:824] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:52.841542 1344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5: No bootstrap required, opened a new log
I20260811 11:09:52.843900 1344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16faf470a9a3488f9f2304f0b593c7f5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43291 } }
I20260811 11:09:52.844030 1344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:52.844054 1344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16faf470a9a3488f9f2304f0b593c7f5, State: Initialized, Role: FOLLOWER
I20260811 11:09:52.844188 1344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16faf470a9a3488f9f2304f0b593c7f5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43291 } }
I20260811 11:09:52.844277 1344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:52.844312 1344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:52.844367 1344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 11:09:52 dist-test-slave-z8x9 krb5kdc[1222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:52.844969 1344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16faf470a9a3488f9f2304f0b593c7f5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43291 } }
I20260811 11:09:52.845057 1344 leader_election.cc:302] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16faf470a9a3488f9f2304f0b593c7f5; no voters:
I20260811 11:09:52.845263 1344 leader_election.cc:288] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:52.845291 1359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:52.845477 1359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 16faf470a9a3488f9f2304f0b593c7f5, State: Running, Role: LEADER
I20260811 11:09:52.845610 1344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:52.845613 1359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16faf470a9a3488f9f2304f0b593c7f5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43291 } }
I20260811 11:09:52.846127 1360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16faf470a9a3488f9f2304f0b593c7f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16faf470a9a3488f9f2304f0b593c7f5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43291 } } }
I20260811 11:09:52.846277 1360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:52.846792 1361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16faf470a9a3488f9f2304f0b593c7f5. Latest consensus state: current_term: 1 leader_uuid: "16faf470a9a3488f9f2304f0b593c7f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16faf470a9a3488f9f2304f0b593c7f5" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 43291 } } }
I20260811 11:09:52.846928 1361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:52.847222 1376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:52.847784 1376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:52.849465 1357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:52.838186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40841 (local address 127.25.227.62:43291)
0811 11:09:52.838388 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:52.838399 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:52.838434 (+ 35us) server_negotiation.cc:407] Connection header received
0811 11:09:52.838990 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:52.839000 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:52.839062 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:52.839216 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:52.839832 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:52.841208 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:52.842011 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:52.842627 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:52.842752 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:52.845365 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:52.845370 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:52.845370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:52.845384 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:52.847675 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:52.848080 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:52.848083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:52.848083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:52.848190 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:52.848393 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:52.848394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:52.848395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:52.848717 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:52.848851 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:52.849107 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 11:09:52.849272 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260811 11:09:52.849553 1376 catalog_manager.cc:1347] Generated new cluster ID: 36f2023eb3e4486aad115baab276ed7f
I20260811 11:09:52.849603 1376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:52.850263 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:52.857537 1357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:52.851478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48357 (local address 127.25.227.62:43291)
0811 11:09:52.851519 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:52.851521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:52.851609 (+ 88us) server_negotiation.cc:407] Connection header received
0811 11:09:52.851667 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:52.851668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:52.851678 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:52.851738 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:52.852230 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:52.852687 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:52.853475 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:52.853694 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:52.853769 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:52.854921 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:52.854923 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:52.854923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:52.854930 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:52.856364 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:52.856729 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:52.856731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:52.856731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:52.856787 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:52.857000 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:52.857001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:52.857002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:52.857112 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:52.857260 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:52.857367 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 11:09:52.857442 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:09:52.859907 1376 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:52.860381 1376 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:52.866866 1376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16faf470a9a3488f9f2304f0b593c7f5: Generated new TSK 0
I20260811 11:09:52.867126 1376 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:52.874238 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1238
2026-08-11T11:09:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1594 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:52 dist-test-slave-z8x9 krb5kdc[1396](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:52 dist-test-slave-z8x9 krb5kdc[1396](info): set up 2 sockets
Aug 11 11:09:52 dist-test-slave-z8x9 krb5kdc[1396](info): commencing operation
krb5kdc: starting...
W20260811 11:09:54.177573 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:54 dist-test-slave-z8x9 krb5kdc[1396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:54.302026 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35863
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:42705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:35863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:54.384086 1417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:54.384351 1417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:54.384392 1417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:54.385571 1417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:54.385646 1417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:54.385669 1417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:54.385690 1417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:54.385720 1417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:54.387236 1417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:42705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:35863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:35863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:54.387532 1417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:54.387780 1417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:54.392869 1428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:54.392993 1426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:54.392936 1430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:54.393117 1417 server_base.cc:1034] running on GCE node
I20260811 11:09:54.393441 1417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:54.393759 1417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:54.394927 1417 hybrid_clock.cc:648] HybridClock initialized: now 1786446594394922 us; error 38 us; skew 500 ppm
Aug 11 11:09:54 dist-test-slave-z8x9 krb5kdc[1396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446594, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:54.397559 1417 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:54.398022 1417 webserver.cc:460] Webserver started at http://127.25.227.62:35611/ using document root <none> and password file <none>
I20260811 11:09:54.398226 1417 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:54.398268 1417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:54.398357 1417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:54.399340 1417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "530b81e8a8ff45c68169ee2a60c8b2ab"
format_stamp: "Formatted at 2026-08-11 11:09:54 on dist-test-slave-z8x9"
server_key: "70d9ce65ac7598e0e987e6504691914b"
server_key_iv: "3a06ae1c68850ad9619aa17646e942bf"
server_key_version: "encryptionkey@0"
I20260811 11:09:54.399649 1417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "530b81e8a8ff45c68169ee2a60c8b2ab"
format_stamp: "Formatted at 2026-08-11 11:09:54 on dist-test-slave-z8x9"
server_key: "70d9ce65ac7598e0e987e6504691914b"
server_key_iv: "3a06ae1c68850ad9619aa17646e942bf"
server_key_version: "encryptionkey@0"
I20260811 11:09:54.400905 1417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 11:09:54.401755 1439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:54.401958 1417 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:09:54.402068 1417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "530b81e8a8ff45c68169ee2a60c8b2ab"
format_stamp: "Formatted at 2026-08-11 11:09:54 on dist-test-slave-z8x9"
server_key: "70d9ce65ac7598e0e987e6504691914b"
server_key_iv: "3a06ae1c68850ad9619aa17646e942bf"
server_key_version: "encryptionkey@0"
I20260811 11:09:54.402145 1417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:54.419837 1417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:54.422068 1417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:54.422256 1417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:54.426770 1417 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:35863
I20260811 11:09:54.426803 1529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:35863 every 8 connection(s)
I20260811 11:09:54.427165 1417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:54.428020 1530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:54.430392 1530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab: Bootstrap starting.
I20260811 11:09:54.430998 1530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:54.431294 1530 log.cc:824] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:54.432011 1530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab: No bootstrap required, opened a new log
I20260811 11:09:54.433735 1530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35863 } }
I20260811 11:09:54.433876 1530 raft_consensus.cc:374] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:54.433898 1530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 530b81e8a8ff45c68169ee2a60c8b2ab, State: Initialized, Role: FOLLOWER
I20260811 11:09:54.434072 1530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35863 } }
I20260811 11:09:54.434136 1530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:54.434194 1530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:54.434252 1530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:54.435129 1530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35863 } }
I20260811 11:09:54.435247 1530 leader_election.cc:302] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 530b81e8a8ff45c68169ee2a60c8b2ab; no voters:
I20260811 11:09:54.435449 1530 leader_election.cc:288] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:54.435490 1535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:54.435667 1535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [term 1 LEADER]: Becoming Leader. State: Replica: 530b81e8a8ff45c68169ee2a60c8b2ab, State: Running, Role: LEADER
I20260811 11:09:54.435729 1530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:54.435848 1535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35863 } }
I20260811 11:09:54.436264 1537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 530b81e8a8ff45c68169ee2a60c8b2ab. Latest consensus state: current_term: 1 leader_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35863 } } }
I20260811 11:09:54.436372 1537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:54.436609 1551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:54.436800 1536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "530b81e8a8ff45c68169ee2a60c8b2ab" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 35863 } } }
I20260811 11:09:54.436897 1536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:54.436988 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1417
I20260811 11:09:54.437096 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:54.437151 1551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:54.437351 26508 external_mini_cluster.cc:1428] Setting key 5af3e44f865fb2cac3adcc7a6cbbbb61
I20260811 11:09:54.438902 1551 catalog_manager.cc:1347] Generated new cluster ID: 6c65df131a0546a09dd86277a0abf994
I20260811 11:09:54.438958 1551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:54.443771 1571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:54.438025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56239 (local address 127.25.227.62:35863)
0811 11:09:54.438444 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:54.438453 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:54.438489 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:09:54.438604 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:54.438611 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:54.438667 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:54.438821 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:54.439209 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:54.440542 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:54.441619 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:54.442246 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:54.442370 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:54.443076 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:54.443080 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:54.443080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:54.443297 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:54.443338 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:54.443353 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:54.443423 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:54.443492 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 11:09:54.443564 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":86,"threads_started":1}
I20260811 11:09:54.444924 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:54.447964 1551 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:54.448479 1551 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:54.450452 1551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 530b81e8a8ff45c68169ee2a60c8b2ab: Generated new TSK 0
I20260811 11:09:54.450625 1551 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:54.452574 1571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:54.447934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40939 (local address 127.25.227.62:35863)
0811 11:09:54.448004 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:54.448006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:54.449351 (+ 1345us) server_negotiation.cc:407] Connection header received
0811 11:09:54.449397 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:54.449398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:54.449410 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:54.449466 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:54.449609 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:54.450374 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:54.451475 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:54.451660 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:54.451710 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:54.452342 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:54.452344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:54.452344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:54.452348 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:54.452361 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:54.452365 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:54.452409 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:54.452479 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 11:09:54.452501 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 11:09:54.454393 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1417
2026-08-11T11:09:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:54 dist-test-slave-z8x9 krb5kdc[1583](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:54 dist-test-slave-z8x9 krb5kdc[1583](info): set up 2 sockets
Aug 11 11:09:54 dist-test-slave-z8x9 krb5kdc[1583](info): commencing operation
krb5kdc: starting...
W20260811 11:09:55.785959 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:55 dist-test-slave-z8x9 krb5kdc[1583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:55.905763 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40281
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:45149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:40281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:55.989064 1608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:55.989332 1608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:55.989374 1608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:55.990543 1608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:55.990615 1608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:55.990639 1608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:55.990669 1608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:55.990700 1608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:55.992158 1608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:45149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:40281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:40281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:55.992448 1608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:55.992686 1608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 11:09:55.997951 1608 server_base.cc:1034] running on GCE node
W20260811 11:09:55.997933 1619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:55.997923 1618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:55.997931 1621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:55.998533 1608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:55.998862 1608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:56.000036 1608 hybrid_clock.cc:648] HybridClock initialized: now 1786446596000032 us; error 40 us; skew 500 ppm
Aug 11 11:09:55 dist-test-slave-z8x9 krb5kdc[1583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446595, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:56.002660 1608 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:56.003162 1608 webserver.cc:460] Webserver started at http://127.25.227.62:42355/ using document root <none> and password file <none>
I20260811 11:09:56.003396 1608 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:56.003466 1608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:56.003621 1608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:56.004679 1608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "3298ba021b6f4892ab21559dd7652356"
format_stamp: "Formatted at 2026-08-11 11:09:55 on dist-test-slave-z8x9"
server_key: "b5b8e5f26094db30b861d6f0a5fec577"
server_key_iv: "83306c56c0381c4006797973a41c32bd"
server_key_version: "encryptionkey@0"
I20260811 11:09:56.005069 1608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "3298ba021b6f4892ab21559dd7652356"
format_stamp: "Formatted at 2026-08-11 11:09:55 on dist-test-slave-z8x9"
server_key: "b5b8e5f26094db30b861d6f0a5fec577"
server_key_iv: "83306c56c0381c4006797973a41c32bd"
server_key_version: "encryptionkey@0"
I20260811 11:09:56.006450 1608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:56.007300 1633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:56.007484 1608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 11:09:56.007587 1608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "3298ba021b6f4892ab21559dd7652356"
format_stamp: "Formatted at 2026-08-11 11:09:55 on dist-test-slave-z8x9"
server_key: "b5b8e5f26094db30b861d6f0a5fec577"
server_key_iv: "83306c56c0381c4006797973a41c32bd"
server_key_version: "encryptionkey@0"
I20260811 11:09:56.007673 1608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:56.011073 1608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:56.013528 1608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:56.013692 1608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:56.018177 1608 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:40281
I20260811 11:09:56.018217 1723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:40281 every 8 connection(s)
I20260811 11:09:56.018551 1608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:56.019589 1724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:56.020361 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1608
I20260811 11:09:56.020481 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:56.020655 26508 external_mini_cluster.cc:1428] Setting key 9f92cfd84abef11a924bfcda8fd4ef5d
I20260811 11:09:56.022917 1724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356: Bootstrap starting.
I20260811 11:09:56.023358 1734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:56.021213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34339 (local address 127.25.227.62:40281)
0811 11:09:56.021413 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:56.021423 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:56.021457 (+ 34us) server_negotiation.cc:407] Connection header received
0811 11:09:56.022019 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:56.022029 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:56.022066 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:56.022234 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:56.022854 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:56.022858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:56.022858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:56.022863 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:56.022907 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:56.022921 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:56.022993 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:56.023105 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 11:09:56.023153 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260811 11:09:56.023687 1724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:56.024011 1724 log.cc:824] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:56.024415 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:56.024757 1724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356: No bootstrap required, opened a new log
I20260811 11:09:56.026911 1734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:56.025953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42107 (local address 127.25.227.62:40281)
0811 11:09:56.025994 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:56.025996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:56.026061 (+ 65us) server_negotiation.cc:407] Connection header received
0811 11:09:56.026144 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:56.026145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:56.026148 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:56.026195 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:56.026704 (+ 509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:56.026705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:56.026705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 11:09:56.026709 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:56.026720 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 11:09:56.026723 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:56.026764 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:56.026825 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 11:09:56.026834 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:09:56.027256 1724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298ba021b6f4892ab21559dd7652356" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40281 } }
I20260811 11:09:56.027448 1724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 11:09:56.027486 1724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3298ba021b6f4892ab21559dd7652356, State: Initialized, Role: FOLLOWER
I20260811 11:09:56.027588 1724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298ba021b6f4892ab21559dd7652356" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40281 } }
I20260811 11:09:56.027655 1724 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 11:09:56.027676 1724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 11:09:56.027704 1724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:56.028209 1724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298ba021b6f4892ab21559dd7652356" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40281 } }
I20260811 11:09:56.028306 1724 leader_election.cc:302] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3298ba021b6f4892ab21559dd7652356; no voters:
I20260811 11:09:56.028419 1724 leader_election.cc:288] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 11:09:56.028494 1746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:56.028650 1746 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [term 1 LEADER]: Becoming Leader. State: Replica: 3298ba021b6f4892ab21559dd7652356, State: Running, Role: LEADER
I20260811 11:09:56.028666 1724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:56.028787 1746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298ba021b6f4892ab21559dd7652356" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40281 } }
I20260811 11:09:56.029160 1752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3298ba021b6f4892ab21559dd7652356. Latest consensus state: current_term: 1 leader_uuid: "3298ba021b6f4892ab21559dd7652356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298ba021b6f4892ab21559dd7652356" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40281 } } }
I20260811 11:09:56.029297 1752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:56.029526 1765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:56.029538 1750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3298ba021b6f4892ab21559dd7652356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3298ba021b6f4892ab21559dd7652356" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 40281 } } }
I20260811 11:09:56.029688 1750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:56.030066 1765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:56.031560 1765 catalog_manager.cc:1347] Generated new cluster ID: 500e39e13e174bfbb6c1f1c368f1b784
I20260811 11:09:56.031634 1765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:56.038800 1765 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:56.038969 1765 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:56.044252 1765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3298ba021b6f4892ab21559dd7652356: Generated new TSK 0
I20260811 11:09:56.044441 1765 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:09:56.054358 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1608
2026-08-11T11:09:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1595 ms)
[----------] 18 tests from AuthTokenIssuingTest (29003 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:56 dist-test-slave-z8x9 krb5kdc[1796](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:56 dist-test-slave-z8x9 krb5kdc[1796](info): set up 2 sockets
Aug 11 11:09:56 dist-test-slave-z8x9 krb5kdc[1796](info): commencing operation
krb5kdc: starting...
W20260811 11:09:57.377338 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:09:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:09:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:09:57.501711 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:32951
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:37889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:32951,127.25.227.61:44209,127.25.227.60:39533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:09:57.588099 1820 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:09:57.588362 1820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:57.588397 1820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:57.588441 1820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:57.589650 1820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:57.589725 1820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:57.589749 1820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:57.589771 1820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:57.589800 1820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:57.591317 1820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:32951,127.25.227.61:44209,127.25.227.60:39533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:32951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:57.591609 1820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:57.591848 1820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:57.596835 1833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:57.596870 1831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:57.596881 1841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:57.597090 1820 server_base.cc:1034] running on GCE node
I20260811 11:09:57.597434 1820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:57.597759 1820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:57.598937 1820 hybrid_clock.cc:648] HybridClock initialized: now 1786446597598918 us; error 30 us; skew 500 ppm
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:57.601562 1820 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:09:57.602007 1820 webserver.cc:460] Webserver started at http://127.25.227.62:35469/ using document root <none> and password file <none>
I20260811 11:09:57.602272 1820 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:57.602344 1820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:57.602499 1820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:57.603566 1820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "d0ed673b6e08422e8176c7256befe342"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "7d7dbbc5a622947d9beef4dd8fc3605f"
server_key_iv: "c6dc709b09c1f30c9e7c91e78625f206"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.603945 1820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "d0ed673b6e08422e8176c7256befe342"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "7d7dbbc5a622947d9beef4dd8fc3605f"
server_key_iv: "c6dc709b09c1f30c9e7c91e78625f206"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.605374 1820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:57.606130 1854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:57.606313 1820 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 11:09:57.606407 1820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "d0ed673b6e08422e8176c7256befe342"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "7d7dbbc5a622947d9beef4dd8fc3605f"
server_key_iv: "c6dc709b09c1f30c9e7c91e78625f206"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.606490 1820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:57.621651 1820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:57.623500 1820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:57.623667 1820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:57.627925 1820 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:32951
I20260811 11:09:57.627962 1956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:32951 every 8 connection(s)
I20260811 11:09:57.628310 1820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:09:57.629335 1961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:57.630800 1961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:57.637384 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1820
I20260811 11:09:57.637504 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:09:57.637681 26508 external_mini_cluster.cc:1428] Setting key 575791ef8c08be57b1c4def7a5e94a75
I20260811 11:09:57.640323 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.631544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51152 (local address 127.25.227.62:32951)
0811 11:09:57.631663 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.631667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.631703 (+ 36us) server_negotiation.cc:407] Connection header received
0811 11:09:57.632241 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.632242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.632271 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.632367 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.632908 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.633768 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.634622 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.634930 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.635054 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.637010 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.637017 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.637018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.637024 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.638705 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.639099 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.639102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.639102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.639184 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.639429 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.639430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.639430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.639632 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.639718 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.639933 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.640088 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":91,"thread_start_us":42,"threads_started":1}
I20260811 11:09:57.640326 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.631382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:32951 (local address 127.0.0.1:51152)
0811 11:09:57.631541 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.631575 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.632077 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.632373 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.632376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.632658 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.632804 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.632808 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.633883 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.633884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.634531 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.634533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.635045 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.635046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.635109 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.635570 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.635578 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.636924 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.638811 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.638818 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.638820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.639015 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.639255 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.639256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.639256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.639351 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.639710 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.639715 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.639787 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.639897 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.640137 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":117,"thread_start_us":77,"threads_started":1}
I20260811 11:09:57.641052 1961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:09:57.641435 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.641312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40902)
0811 11:09:57.641360 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.641403 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 11:09:57.641610 1868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
I20260811 11:09:57.642031 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.641964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40916)
0811 11:09:57.641992 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.642015 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 11:09:57.642156 1961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:44209: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.25.227.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab.
Entry for principal kudu/127.25.227.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab.
I20260811 11:09:57.663959 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:44209
--webserver_interface=127.25.227.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab
--principal=kudu/127.25.227.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:37889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:32951,127.25.227.61:44209,127.25.227.60:39533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:09:57.691362 1961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } attempt: 1
I20260811 11:09:57.691936 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.691790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40922)
0811 11:09:57.691857 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.691903 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 11:09:57.692358 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.692270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40936)
0811 11:09:57.692312 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.692338 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 11:09:57.692487 1961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:44209: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
W20260811 11:09:57.749269 1970 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:09:57.749490 1970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:57.749507 1970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:57.749527 1970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:57.750589 1970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:57.750626 1970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:57.750640 1970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:57.750653 1970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:57.750665 1970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:57.752101 1970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:32951,127.25.227.61:44209,127.25.227.60:39533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab
--principal=kudu/127.25.227.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:44209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.227.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:57.752301 1970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:57.752472 1970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:57.757388 1982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:57.757382 1980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:57.757486 1970 server_base.cc:1034] running on GCE node
W20260811 11:09:57.757382 1985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:57.757860 1970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:57.758157 1970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:57.759326 1970 hybrid_clock.cc:648] HybridClock initialized: now 1786446597759318 us; error 31 us; skew 500 ppm
I20260811 11:09:57.760648 1961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } attempt: 2
I20260811 11:09:57.761057 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.760929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40952)
0811 11:09:57.760991 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.761026 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 11:09:57.761453 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.761341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40968)
0811 11:09:57.761395 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.761430 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 11:09:57.761543 1961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:44209: Network error: Client connection negotiation failed: client connection to 127.25.227.61:44209: connect: Connection refused (error 111)
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:57.762189 1970 init.cc:377] Logged in from keytab as kudu/127.25.227.61@KRBTEST.COM (short username kudu)
I20260811 11:09:57.762677 1970 webserver.cc:460] Webserver started at http://127.25.227.61:40779/ using document root <none> and password file <none>
I20260811 11:09:57.762925 1970 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:57.762995 1970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:57.763159 1970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:57.764241 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data/instance:
uuid: "9ab13e2b59b342a2b2c6009146c09f5f"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "c2c2654d1a3f7cba0b5b5103b0699688"
server_key_iv: "4f44421989396b154961073b782d4074"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.764624 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal/instance:
uuid: "9ab13e2b59b342a2b2c6009146c09f5f"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "c2c2654d1a3f7cba0b5b5103b0699688"
server_key_iv: "4f44421989396b154961073b782d4074"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.766084 1970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 11:09:57.766844 1996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:57.767128 1970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 11:09:57.767238 1970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal
uuid: "9ab13e2b59b342a2b2c6009146c09f5f"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "c2c2654d1a3f7cba0b5b5103b0699688"
server_key_iv: "4f44421989396b154961073b782d4074"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.767316 1970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:57.787931 1970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:57.790527 1970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:57.790701 1970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:57.795111 1970 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.61:44209
I20260811 11:09:57.795178 2087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.61:44209 every 8 connection(s)
I20260811 11:09:57.795542 1970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
I20260811 11:09:57.796595 2088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:57.798297 2088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:09:57.799799 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 1970
I20260811 11:09:57.799891 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-1/wal/instance
I20260811 11:09:57.800101 26508 external_mini_cluster.cc:1428] Setting key e8e84f673015569021717b299a43bca2
WARNING: no policy specified for kudu/127.25.227.60@KRBTEST.COM; defaulting to no policy
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.60@KRBTEST.COM" created.
I20260811 11:09:57.812774 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.799009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:32951 (local address 127.0.0.1:51160)
0811 11:09:57.799199 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.799251 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.799710 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.800040 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.800044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.800350 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.800558 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.800562 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.801539 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.801540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.802376 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.802379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.802950 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.802951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.803050 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.807665 (+ 4615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.807674 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.809370 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.811134 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.811141 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.811144 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.811475 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.811714 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.811715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.811716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.811880 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.812230 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.812236 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.812380 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.812467 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.812597 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":115,"threads_started":1}
I20260811 11:09:57.812774 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.799062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51160 (local address 127.25.227.62:32951)
0811 11:09:57.799132 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.799134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.799347 (+ 213us) server_negotiation.cc:407] Connection header received
0811 11:09:57.799821 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.799823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.799841 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.799952 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.800674 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.801447 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.802474 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.802828 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.802908 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.809471 (+ 6563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.809473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.809473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.809480 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.811047 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.811584 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.811585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.811585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.811643 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.811959 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.811960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.811960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.812153 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.812231 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.812518 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.812623 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:09:57.813437 2088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:09:57.820966 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.813764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40982)
0811 11:09:57.813813 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.813822 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.813859 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.814134 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.814135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.814285 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.814333 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.814335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.815204 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.815205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.815792 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.815794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.816315 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.816316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.816383 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.816839 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.816844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.818149 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.819932 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.819933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.819934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.820095 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.820334 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.820335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.820335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.820389 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.820717 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.820718 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.820761 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.820813 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.820894 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 11:09:57.821108 2100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.813832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40982 (local address 127.25.227.61:44209)
0811 11:09:57.813991 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.813995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.814012 (+ 17us) server_negotiation.cc:407] Connection header received
0811 11:09:57.814029 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.814031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.814041 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.814119 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.814410 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.815101 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.815886 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.816190 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.816316 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.818257 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.818265 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.818265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.818272 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.819836 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.820193 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.820196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.820196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.820265 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.820458 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.820458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.820459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.820654 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.820724 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.820845 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.820954 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260811 11:09:57.821741 2088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:09:57.822130 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.822000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57688)
0811 11:09:57.822048 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.822099 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:09:57.822291 2001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
I20260811 11:09:57.822788 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.822704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57702)
0811 11:09:57.822740 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.822766 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 11:09:57.822901 2088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:39533: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab.
Entry for principal kudu/127.25.227.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab.
I20260811 11:09:57.828297 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:39533
--webserver_interface=127.25.227.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab
--principal=kudu/127.25.227.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:37889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:32951,127.25.227.61:44209,127.25.227.60:39533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:09:57.852682 1961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } attempt: 3
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:09:57.860086 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.853089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40988)
0811 11:09:57.853146 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.853178 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.853270 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.853476 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.853477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.853667 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.853735 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.853737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.854418 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.854420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.854938 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.854940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.855343 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.855345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.855433 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.855947 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.855952 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.857430 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.859017 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.859018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.859019 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.859197 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.859420 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.859421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.859421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.859488 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.859749 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.859751 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.859798 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.859878 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.859981 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 11:09:57.860086 2100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.853181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40988 (local address 127.25.227.61:44209)
0811 11:09:57.853246 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.853248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.853259 (+ 11us) server_negotiation.cc:407] Connection header received
0811 11:09:57.853385 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.853386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.853396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.853456 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.853828 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.854328 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.855027 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.855262 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.855345 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.857522 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.857524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.857524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.857535 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.858927 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.859290 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.859291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.859292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.859351 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.859558 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.859559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.859559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.859671 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.859745 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.859919 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.859995 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:09:57.860608 1961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:09:57.861006 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.860884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57708)
0811 11:09:57.860940 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.860979 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:09:57.861388 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.861285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57722)
0811 11:09:57.861338 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.861366 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 11:09:57.861509 1961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:39533: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
I20260811 11:09:57.872097 2088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } attempt: 1
I20260811 11:09:57.872486 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.872369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57728)
0811 11:09:57.872427 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.872460 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:09:57.872906 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.872807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57744)
0811 11:09:57.872853 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.872878 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:09:57.873028 2088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:39533: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
I20260811 11:09:57.892658 1961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } attempt: 1
I20260811 11:09:57.893215 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.893038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57750)
0811 11:09:57.893102 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.893144 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 11:09:57.893582 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.893496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57754)
0811 11:09:57.893539 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.893565 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 11:09:57.893710 1961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:39533: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
W20260811 11:09:57.915134 2103 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:09:57.915387 2103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:09:57.915427 2103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:09:57.915467 2103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:09:57.916589 2103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:09:57.916656 2103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:09:57.916680 2103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:09:57.916715 2103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:09:57.916752 2103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:09:57.918344 2103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:37889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:32951,127.25.227.61:44209,127.25.227.60:39533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab
--principal=kudu/127.25.227.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:39533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.227.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:09:57.918635 2103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:09:57.918874 2103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:09:57.923962 2115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:09:57.923955 2116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:57.923990 2103 server_base.cc:1034] running on GCE node
W20260811 11:09:57.923956 2122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:09:57.924566 2103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:09:57.924867 2103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:09:57.926054 2103 hybrid_clock.cc:648] HybridClock initialized: now 1786446597926040 us; error 45 us; skew 500 ppm
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:09:57.928536 2103 init.cc:377] Logged in from keytab as kudu/127.25.227.60@KRBTEST.COM (short username kudu)
I20260811 11:09:57.928979 2103 webserver.cc:460] Webserver started at http://127.25.227.60:43627/ using document root <none> and password file <none>
I20260811 11:09:57.929262 2103 fs_manager.cc:359] Metadata directory not provided
I20260811 11:09:57.929335 2103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:09:57.929500 2103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:09:57.930578 2103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data/instance:
uuid: "3997011d019d4a029e5fa289f1db393f"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "c04a00b831f9ff9119636a649a1c73f7"
server_key_iv: "e42848a90a145fb9f6af98acd25ecedf"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.930950 2103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal/instance:
uuid: "3997011d019d4a029e5fa289f1db393f"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "c04a00b831f9ff9119636a649a1c73f7"
server_key_iv: "e42848a90a145fb9f6af98acd25ecedf"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.932301 2103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:09:57.933056 2130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:09:57.933300 2103 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:09:57.933400 2103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal
uuid: "3997011d019d4a029e5fa289f1db393f"
format_stamp: "Formatted at 2026-08-11 11:09:57 on dist-test-slave-z8x9"
server_key: "c04a00b831f9ff9119636a649a1c73f7"
server_key_iv: "e42848a90a145fb9f6af98acd25ecedf"
server_key_version: "encryptionkey@0"
I20260811 11:09:57.933482 2103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:09:57.941227 2088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } attempt: 2
I20260811 11:09:57.941653 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.941521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57768)
0811 11:09:57.941583 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.941622 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 11:09:57.942001 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.941890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57780)
0811 11:09:57.941937 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.941962 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:09:57.942092 2088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:39533: Network error: Client connection negotiation failed: client connection to 127.25.227.60:39533: connect: Connection refused (error 111)
I20260811 11:09:57.943823 2103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:09:57.946225 2103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:09:57.946388 2103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:09:57.950367 2103 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.60:39533
I20260811 11:09:57.950416 2220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.60:39533 every 8 connection(s)
I20260811 11:09:57.950827 2103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
I20260811 11:09:57.951902 2221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:09:57.953549 2221 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:09:57.953884 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2103
I20260811 11:09:57.953984 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786446315517896-26508-0/minicluster-data/master-2/wal/instance
I20260811 11:09:57.954236 26508 external_mini_cluster.cc:1428] Setting key ea602a921bd3d5bb3349404eb03659dd
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:09:57.964233 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.954409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51170 (local address 127.25.227.62:32951)
0811 11:09:57.954788 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.954791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.954806 (+ 15us) server_negotiation.cc:407] Connection header received
0811 11:09:57.955490 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.955491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.955504 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.955567 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.956124 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.956605 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.957715 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.958011 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.958088 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.960685 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.960689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.960689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.960701 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.962529 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.963039 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.963041 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.963041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.963119 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.963439 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.963440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.963440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.963616 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.963684 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.964020 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.964108 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346}
I20260811 11:09:57.964397 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.954393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:32951 (local address 127.0.0.1:51170)
0811 11:09:57.954640 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.954686 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.955360 (+ 674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.955602 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.955605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.955875 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.956029 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.956033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.956683 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.956684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.957638 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.957641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.958177 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.958178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.958312 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.958928 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.958939 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.960585 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.962624 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.962631 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.962633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.962954 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.963191 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.963192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.963193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.963365 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.963688 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.963695 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.963865 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.963952 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.964131 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":106,"threads_started":1}
I20260811 11:09:57.964498 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.954645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57782 (local address 127.25.227.60:39533)
0811 11:09:57.954791 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.954795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.954939 (+ 144us) server_negotiation.cc:407] Connection header received
0811 11:09:57.955362 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.955372 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.955401 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.955493 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.956168 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.957220 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.958097 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.958519 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.958596 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.961305 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.961314 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.961315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.961322 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.963104 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.963495 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.963499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.963499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.963555 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.963790 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.963791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.963791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.963958 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.964111 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.964216 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.964328 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260811 11:09:57.965418 2221 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:09:57.968856 1961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } attempt: 2
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:09:57.972889 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.965682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:44209 (local address 127.0.0.1:40994)
0811 11:09:57.965738 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.965748 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.965790 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.965973 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.965974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.966114 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.966143 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.966144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.966757 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.966758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.967235 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.967237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.967621 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.967622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.967683 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.968198 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.968203 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.969562 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.971420 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.971421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.971421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.971619 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.972071 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.972072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.972072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.972140 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.972524 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.972525 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.972576 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.972684 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.972789 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:09:57.972937 2100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.965792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40994 (local address 127.25.227.61:44209)
0811 11:09:57.965857 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.965859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.965866 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:09:57.965889 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.965890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.965899 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.965969 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.966232 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.966682 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.967324 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.967549 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.967624 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.969653 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.969654 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.969655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.969662 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.971344 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.971918 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.971919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.971920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.971984 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.972193 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.972194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.972194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.972344 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.972534 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.972727 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.972814 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 11:09:57.973691 2221 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:09:57.974646 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.965433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51174 (local address 127.25.227.62:32951)
0811 11:09:57.965487 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.965489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.965497 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:09:57.965520 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.965521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.965531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.965578 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.966168 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.966630 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.967307 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.967505 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.967581 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.970897 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.970898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.970899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.970905 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.972527 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.972937 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.972939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.972939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.972996 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.973248 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.973250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.973250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.973387 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.973576 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.973783 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.974552 (+ 769us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:09:57.978060 1963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.969131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57792)
0811 11:09:57.969211 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.969222 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.969293 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.969452 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.969454 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.969608 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.969653 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.969655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.970432 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.970433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.971245 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.971281 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.971763 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.971765 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.971829 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.972589 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.972594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.974077 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.976146 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.976147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.976147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.976374 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.976808 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.976809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.976809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.976880 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.977733 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.977734 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.977781 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.977865 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.977968 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 11:09:57.978060 2225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.969244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57792 (local address 127.25.227.60:39533)
0811 11:09:57.969306 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.969308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.969318 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:57.969341 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.969342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.969353 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.969729 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.969759 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.970349 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.971377 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.971695 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.971755 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.974171 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.974173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.974173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.974180 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.976036 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.976645 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.976645 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.976646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.976695 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.977514 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.977515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.977516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.977627 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.977733 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.977904 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.977976 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 11:09:57 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:09:57.980338 1961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342: Bootstrap starting.
I20260811 11:09:57.981112 1961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:57.981524 1961 log.cc:824] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:57.981963 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.974075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57802)
0811 11:09:57.974135 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:57.974146 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:57.974183 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:57.974472 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:57.974473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:57.974602 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:57.974629 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.974630 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.975523 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.975524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.975997 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:57.975998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.976452 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.976453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:57.976511 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.976950 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:57.976954 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:57.978388 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:57.980800 (+ 2412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.980801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.980802 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.981028 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.981265 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:57.981266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:57.981266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:57.981330 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:57.981642 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:57.981643 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:57.981680 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 11:09:57.981756 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 11:09:57.981854 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 11:09:57.982194 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.974142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.25.227.60:39533)
0811 11:09:57.974313 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.974315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.974325 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:57.974346 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.974347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.974357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.974426 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.974703 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.975439 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.976077 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.976375 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.976447 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.978468 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.978469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.978470 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.978477 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.980710 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.981116 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.981117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.981117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.981195 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.981394 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.981395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.981395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.981554 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.981619 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.982071 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.982125 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":113,"threads_started":1}
I20260811 11:09:57.982789 1961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342: No bootstrap required, opened a new log
I20260811 11:09:57.983369 2221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: Bootstrap starting.
I20260811 11:09:57.983959 2221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:57.984234 2221 log.cc:824] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:57.984345 1961 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:57.984491 1961 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ed673b6e08422e8176c7256befe342, State: Initialized, Role: FOLLOWER
I20260811 11:09:57.984602 1961 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:57.984889 2231 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:57.984975 1961 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:57.985064 2231 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:09:57.985234 2221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: No bootstrap required, opened a new log
I20260811 11:09:57.986081 2100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.975407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41010 (local address 127.25.227.61:44209)
0811 11:09:57.975446 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.975448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.975455 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:09:57.975478 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.975479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.975488 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.975539 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.976135 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.976695 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.977706 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.978026 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:57.978090 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:57.980864 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:57.980865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:57.980865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:57.980872 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:57.984786 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.985201 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.985203 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.985203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.985266 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:57.985496 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:57.985497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:57.985497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:57.985658 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:57.985856 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:57.985907 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 11:09:57.985993 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 11:09:57.987032 2249 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:09:57.987136 2249 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:09:57.987954 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:09:57.988821 1907 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d0ed673b6e08422e8176c7256befe342"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51174
I20260811 11:09:57.988958 1907 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 11:09:57.989008 1907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:57.989737 1907 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:57.989934 1907 leader_election.cc:288] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [CANDIDATE]: Term 1 election: Requested vote from peers 9ab13e2b59b342a2b2c6009146c09f5f (127.25.227.61:44209), 3997011d019d4a029e5fa289f1db393f (127.25.227.60:39533)
I20260811 11:09:57.987800 1820 master_runner.cc:186] Error getting master registration for 127.25.227.61:44209: OK, instance_id { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" instance_seqno: 1786446597793844 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:09:57.990160 1820 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:09:57.990545 2221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:57.990773 2221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3997011d019d4a029e5fa289f1db393f, State: Initialized, Role: FOLLOWER
I20260811 11:09:57.990916 2221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:57.991285 2221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:57.991348 2171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0ed673b6e08422e8176c7256befe342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3997011d019d4a029e5fa289f1db393f"
I20260811 11:09:57.991482 2171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:57.992295 2171 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ed673b6e08422e8176c7256befe342 in term 1.
I20260811 11:09:57.992538 1868 leader_election.cc:302] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3997011d019d4a029e5fa289f1db393f, d0ed673b6e08422e8176c7256befe342; no voters:
I20260811 11:09:57.992662 2231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:09:57.992831 2231 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [term 1 LEADER]: Becoming Leader. State: Replica: d0ed673b6e08422e8176c7256befe342, State: Running, Role: LEADER
I20260811 11:09:57.992914 2231 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:57.993350 2231 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ed673b6e08422e8176c7256befe342. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:57.993467 2231 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:57.992969 2258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:57.993651 2293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:09:57.993690 2258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 11:09:57.993321 2288 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:09:57.993762 2288 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:09:57.993846 2293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:09:57.995267 2103 master_runner.cc:186] Error getting master registration for 127.25.227.61:44209: OK, instance_id { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" instance_seqno: 1786446597793844 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:09:57.997870 2103 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:09:58.007220 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.992384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.25.227.60:39533)
0811 11:09:57.992447 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.992449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.998236 (+ 5787us) server_negotiation.cc:407] Connection header received
0811 11:09:57.998340 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.998341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.998351 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.998381 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.999107 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.999798 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.000794 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.001780 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.001830 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:58.003522 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:58.003524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:58.003524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:58.003530 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:58.005758 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.006207 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.006209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.006210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.006272 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.006497 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.006498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.006498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.006657 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:58.006754 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:58.007004 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 11:09:58.007102 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 11:09:58.011703 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.991102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51178 (local address 127.25.227.62:32951)
0811 11:09:57.991141 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.991143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.995682 (+ 4539us) server_negotiation.cc:407] Connection header received
0811 11:09:57.995990 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.995991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.996014 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.996052 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.999477 (+ 3425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.000155 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.003559 (+ 3404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.003862 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.003913 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:58.007893 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:58.007894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:58.007894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:58.007903 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:58.010013 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.010719 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.010720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.010720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.010775 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.011088 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.011089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.011089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.011219 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:58.011314 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:58.011511 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 11:09:58.011594 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 11:09:58.012396 2100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:57.991059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41020 (local address 127.25.227.61:44209)
0811 11:09:57.991111 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:57.991113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:57.995775 (+ 4662us) server_negotiation.cc:407] Connection header received
0811 11:09:57.996128 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:57.996129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:57.996154 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:57.996185 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:57.998568 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:57.999355 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.003093 (+ 3738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.003405 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.003451 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:58.007994 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:58.007995 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:58.007995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:58.008002 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:58.010013 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.010695 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.010697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.010697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.010761 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.010970 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.010971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.010971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.011108 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:58.011195 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:58.012207 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0811 11:09:58.012297 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:09:58.013736 2171 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [term 1 FOLLOWER]: Refusing update from remote peer d0ed673b6e08422e8176c7256befe342: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:58.014132 2289 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:58.015853 2258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ed673b6e08422e8176c7256befe342. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.015944 2258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:09:58.017369 2231 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.017460 2231 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:58.017526 2297 mvcc.cc:205] Tried to move back new op lower bound from 7317285265461452800 to 7317285265379688448. Current Snapshot: MvccSnapshot[applied={T|T < 7317285265461452800}]
I20260811 11:09:58.018011 2293 catalog_manager.cc:1347] Generated new cluster ID: 5291bc7eff7c40ea82aa5ed22aefbacd
I20260811 11:09:58.018059 2293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:09:58.018018 2258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.018090 2258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:09:58.018409 2298 mvcc.cc:205] Tried to move back new op lower bound from 7317285265461452800 to 7317285265379688448. Current Snapshot: MvccSnapshot[applied={T|T < 7317285265461452800}]
I20260811 11:09:58.033205 2088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } attempt: 3
Aug 11 11:09:58 dist-test-slave-z8x9 krb5kdc[1796](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446597, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:09:58.041473 2293 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:09:58.043074 2293 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:09:58.043682 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:58.033496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:39533 (local address 127.0.0.1:57822)
0811 11:09:58.033548 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 11:09:58.033560 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:09:58.033604 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:09:58.034134 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:09:58.034135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:09:58.034316 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:09:58.034362 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:58.034363 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.035539 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.035540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:58.036313 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:09:58.036315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.036866 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.036868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:09:58.036930 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:58.037518 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:09:58.037524 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:09:58.039123 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:09:58.042540 (+ 3417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:58.042541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:58.042541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:58.042770 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:58.042991 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:09:58.042992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:09:58.042992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:09:58.043053 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:09:58.043361 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:09:58.043362 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:09:58.043409 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 11:09:58.043473 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 11:09:58.043576 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 11:09:58.044047 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:58.033599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57822 (local address 127.25.227.60:39533)
0811 11:09:58.033645 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.033648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.033656 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:09:58.033676 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.033677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.033686 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.033741 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.034615 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.035358 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.036455 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:58.036743 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:58.036794 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:58.039592 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:09:58.039594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:09:58.039594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:09:58.039601 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:09:58.041691 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.042855 (+ 1164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.042857 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.042857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.042918 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:09:58.043123 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:09:58.043124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:09:58.043124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:09:58.043263 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:09:58.043330 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:58.043870 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 11:09:58.043954 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:09:58.045558 2088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: Bootstrap starting.
I20260811 11:09:58.046326 2088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: Neither blocks nor log segments found. Creating new log.
I20260811 11:09:58.046640 2088 log.cc:824] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: Log is configured to *not* fsync() on all Append() calls
I20260811 11:09:58.047458 2088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: No bootstrap required, opened a new log
I20260811 11:09:58.049494 2088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:58.049635 2088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab13e2b59b342a2b2c6009146c09f5f, State: Initialized, Role: FOLLOWER
I20260811 11:09:58.049721 2088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } }
I20260811 11:09:58.050064 2088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:09:58.050173 2036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:09:58.051152 2036 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [term 1 FOLLOWER]: Refusing update from remote peer d0ed673b6e08422e8176c7256befe342: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:09:58.051388 2040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0ed673b6e08422e8176c7256befe342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9ab13e2b59b342a2b2c6009146c09f5f"
I20260811 11:09:58.051697 2231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:09:58.052186 2040 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ed673b6e08422e8176c7256befe342 in term 1.
I20260811 11:09:58.054574 2306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.054665 2306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:09:58.054723 2306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ed673b6e08422e8176c7256befe342. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.054778 2306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:09:58.054816 2306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.054862 2306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:09:58.057698 2328 mvcc.cc:205] Tried to move back new op lower bound from 7317285265568583680 to 7317285265379688448. Current Snapshot: MvccSnapshot[applied={T|T < 7317285265461452800}]
I20260811 11:09:58.058650 2332 catalog_manager.cc:1259] Loaded cluster ID: 5291bc7eff7c40ea82aa5ed22aefbacd
I20260811 11:09:58.058691 2332 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: loading cluster ID for follower catalog manager: success
I20260811 11:09:58.059773 2332 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: acquiring CA information for follower catalog manager: success
W20260811 11:09:58.059895 2332 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 11:09:58.061666 2231 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0ed673b6e08422e8176c7256befe342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0ed673b6e08422e8176c7256befe342" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 32951 } } peers { permanent_uuid: "9ab13e2b59b342a2b2c6009146c09f5f" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 44209 } } peers { permanent_uuid: "3997011d019d4a029e5fa289f1db393f" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 39533 } } }
I20260811 11:09:58.061765 2231 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342 [sys.catalog]: This master's current role is: LEADER
I20260811 11:09:58.064597 2293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0ed673b6e08422e8176c7256befe342: Generated new TSK 0
I20260811 11:09:58.064824 2293 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 11:09:58.103391 1964 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.101536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51188 (local address 127.25.227.62:32951)
0811 11:09:58.101584 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.101586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.102629 (+ 1043us) server_negotiation.cc:407] Connection header received
0811 11:09:58.102760 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.102762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.102775 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.102808 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.103315 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51188: BlockingRecv error: recv got EOF from 127.0.0.1:51188 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 11:09:58.104380 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.101844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41026 (local address 127.25.227.61:44209)
0811 11:09:58.101887 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.101889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.103830 (+ 1941us) server_negotiation.cc:407] Connection header received
0811 11:09:58.103934 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.103935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.103947 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.103977 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.104319 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41026: BlockingRecv error: recv got EOF from 127.0.0.1:41026 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 11:09:58.105348 2227 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.102327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57824 (local address 127.25.227.60:39533)
0811 11:09:58.102370 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.102372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.104770 (+ 2398us) server_negotiation.cc:407] Connection header received
0811 11:09:58.104876 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.104877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.104887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.104916 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.105290 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57824: BlockingRecv error: recv got EOF from 127.0.0.1:57824 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 11:09:58.107898 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.107112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41030 (local address 127.25.227.61:44209)
0811 11:09:58.107150 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.107151 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.107354 (+ 203us) server_negotiation.cc:407] Connection header received
0811 11:09:58.107462 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.107463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.107480 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.107510 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.107855 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41030: BlockingRecv error: recv got EOF from 127.0.0.1:41030 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 11:09:58.113557 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.112737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41042 (local address 127.25.227.61:44209)
0811 11:09:58.112772 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.112773 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.113031 (+ 258us) server_negotiation.cc:407] Connection header received
0811 11:09:58.113127 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.113128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.113138 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.113190 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.113516 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41042: BlockingRecv error: recv got EOF from 127.0.0.1:41042 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 11:09:58.117539 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.116741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41054 (local address 127.25.227.61:44209)
0811 11:09:58.116775 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.116777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.117016 (+ 239us) server_negotiation.cc:407] Connection header received
0811 11:09:58.117109 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.117110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.117136 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.117166 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.117499 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41054: BlockingRecv error: recv got EOF from 127.0.0.1:41054 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 11:09:58.123543 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.122778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41058 (local address 127.25.227.61:44209)
0811 11:09:58.122815 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.122816 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.123039 (+ 223us) server_negotiation.cc:407] Connection header received
0811 11:09:58.123137 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.123138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.123148 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.123176 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.123497 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41058: BlockingRecv error: recv got EOF from 127.0.0.1:41058 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 11:09:58.133827 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.132918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41062 (local address 127.25.227.61:44209)
0811 11:09:58.132958 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.132961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.133248 (+ 287us) server_negotiation.cc:407] Connection header received
0811 11:09:58.133352 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.133353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.133364 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.133393 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.133759 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41062: BlockingRecv error: recv got EOF from 127.0.0.1:41062 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 11:09:58.152295 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.151291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41064 (local address 127.25.227.61:44209)
0811 11:09:58.151337 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.151339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.151663 (+ 324us) server_negotiation.cc:407] Connection header received
0811 11:09:58.151786 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.151788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.151800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.151831 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.152229 (+ 398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41064: BlockingRecv error: recv got EOF from 127.0.0.1:41064 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 11:09:58.186723 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.185949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41076 (local address 127.25.227.61:44209)
0811 11:09:58.186009 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.186011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.186092 (+ 81us) server_negotiation.cc:407] Connection header received
0811 11:09:58.186205 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.186207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.186221 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.186289 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.186638 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41076: BlockingRecv error: recv got EOF from 127.0.0.1:41076 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 11:09:58.252744 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.251972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41082 (local address 127.25.227.61:44209)
0811 11:09:58.252052 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.252055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.252181 (+ 126us) server_negotiation.cc:407] Connection header received
0811 11:09:58.252235 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.252236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.252247 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.252307 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.252682 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41082: BlockingRecv error: recv got EOF from 127.0.0.1:41082 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 11:09:58.382825 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.382060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41090 (local address 127.25.227.61:44209)
0811 11:09:58.382127 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.382129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.382228 (+ 99us) server_negotiation.cc:407] Connection header received
0811 11:09:58.382279 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.382280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.382293 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.382361 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.382741 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41090: BlockingRecv error: recv got EOF from 127.0.0.1:41090 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 11:09:58.640610 2100 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:09:58.640052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41106 (local address 127.25.227.61:44209)
0811 11:09:58.640120 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:58.640122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:58.640132 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:09:58.640164 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:58.640165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:58.640174 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:58.640226 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:09:58.640562 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41106: BlockingRecv error: recv got EOF from 127.0.0.1:41106 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 11:09:58.994227 2288 catalog_manager.cc:1259] Loaded cluster ID: 5291bc7eff7c40ea82aa5ed22aefbacd
I20260811 11:09:58.994318 2288 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: loading cluster ID for follower catalog manager: success
I20260811 11:09:58.995203 2288 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: acquiring CA information for follower catalog manager: success
I20260811 11:09:58.995487 2288 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3997011d019d4a029e5fa289f1db393f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:09:59.060550 2332 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9ab13e2b59b342a2b2c6009146c09f5f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:09:59.156713 2450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:59.153899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41118 (local address 127.25.227.61:44209)
0811 11:09:59.154023 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:59.154031 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:59.154108 (+ 77us) server_negotiation.cc:407] Connection header received
0811 11:09:59.154206 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:59.154207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:59.154291 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:59.154388 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:59.154558 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.155072 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.155862 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.156063 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.156143 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:59.156331 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:59.156448 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:59.156543 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:59.156584 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 11:09:59.156606 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260811 11:09:59.160807 2460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:59.158528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57840 (local address 127.25.227.60:39533)
0811 11:09:59.158655 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:59.158658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:59.158690 (+ 32us) server_negotiation.cc:407] Connection header received
0811 11:09:59.158779 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:59.158780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:59.158816 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:59.158885 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:59.158986 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.159449 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.160111 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.160297 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.160346 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:59.160475 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:59.160566 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:59.160620 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:59.160658 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 11:09:59.160674 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260811 11:09:59.165218 2450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:59.162506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41120 (local address 127.25.227.61:44209)
0811 11:09:59.162700 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:59.162702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:59.162710 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:09:59.162733 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:59.162734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:59.162743 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:59.162792 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:59.162923 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.163629 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.164553 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.164791 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.164856 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:59.164970 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:59.165000 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:59.165051 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:59.165095 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 11:09:59.165118 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260811 11:09:59.165545 2460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:59.162700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57848 (local address 127.25.227.60:39533)
0811 11:09:59.162736 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:59.162737 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:59.162911 (+ 174us) server_negotiation.cc:407] Connection header received
0811 11:09:59.162992 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:59.162993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:59.163003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:59.163051 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:59.163208 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.163650 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.164783 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.165067 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.165127 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:59.165303 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:59.165341 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:59.165375 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:59.165448 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 11:09:59.165469 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 11:09:59.166199 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:09:59.162441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51198 (local address 127.25.227.62:32951)
0811 11:09:59.162554 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 11:09:59.162556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:09:59.162667 (+ 111us) server_negotiation.cc:407] Connection header received
0811 11:09:59.162764 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:09:59.162765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:09:59.162815 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:09:59.162905 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:09:59.163030 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.163776 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.165185 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:09:59.165484 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:09:59.165562 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:09:59.165838 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:09:59.165943 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:09:59.166019 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 11:09:59.166092 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 11:09:59.166115 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":54,"threads_started":1}
I20260811 11:09:59.167990 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1820
I20260811 11:09:59.193360 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 1970
I20260811 11:09:59.206571 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2103
2026-08-11T11:09:59Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3152 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 11:09:59 dist-test-slave-z8x9 krb5kdc[2482](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 11:09:59 dist-test-slave-z8x9 krb5kdc[2482](info): set up 2 sockets
Aug 11 11:09:59 dist-test-slave-z8x9 krb5kdc[2482](info): commencing operation
krb5kdc: starting...
W20260811 11:10:00.512244 26508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/test-user.keytab.
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T11:10:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T11:10:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.25.227.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
Entry for principal kudu/127.25.227.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab.
I20260811 11:10:00.639411 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41373
--webserver_interface=127.25.227.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41373,127.25.227.61:37331,127.25.227.60:40325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 11:10:00.726930 2506 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:10:00.727154 2506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:10:00.727171 2506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:10:00.727193 2506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:10:00.728391 2506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:10:00.728436 2506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:10:00.728451 2506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:10:00.728464 2506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:10:00.728518 2506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:10:00.730139 2506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41373,127.25.227.61:37331,127.25.227.60:40325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.62.keytab
--principal=kudu/127.25.227.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.62:41373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.25.227.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:10:00.730420 2506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:10:00.730669 2506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:10:00.735726 2514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:10:00.735738 2516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:10:00.735774 2518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:10:00.735774 2506 server_base.cc:1034] running on GCE node
I20260811 11:10:00.736270 2506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:10:00.736619 2506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:10:00.737784 2506 hybrid_clock.cc:648] HybridClock initialized: now 1786446600737764 us; error 43 us; skew 500 ppm
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:10:00.740525 2506 init.cc:377] Logged in from keytab as kudu/127.25.227.62@KRBTEST.COM (short username kudu)
I20260811 11:10:00.741020 2506 webserver.cc:460] Webserver started at http://127.25.227.62:34291/ using document root <none> and password file <none>
I20260811 11:10:00.741343 2506 fs_manager.cc:359] Metadata directory not provided
I20260811 11:10:00.741396 2506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:10:00.741568 2506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:10:00.742621 2506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data/instance:
uuid: "9a9e890e4a674d64b88fe55f88755ca9"
format_stamp: "Formatted at 2026-08-11 11:10:00 on dist-test-slave-z8x9"
server_key: "4fd2a8e44a0175ef5c6fdab589f5393d"
server_key_iv: "bc5cbde6220787de6f6b95826827dd12"
server_key_version: "encryptionkey@0"
I20260811 11:10:00.742995 2506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal/instance:
uuid: "9a9e890e4a674d64b88fe55f88755ca9"
format_stamp: "Formatted at 2026-08-11 11:10:00 on dist-test-slave-z8x9"
server_key: "4fd2a8e44a0175ef5c6fdab589f5393d"
server_key_iv: "bc5cbde6220787de6f6b95826827dd12"
server_key_version: "encryptionkey@0"
I20260811 11:10:00.744359 2506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:10:00.745126 2528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:10:00.745360 2506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:10:00.745440 2506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal
uuid: "9a9e890e4a674d64b88fe55f88755ca9"
format_stamp: "Formatted at 2026-08-11 11:10:00 on dist-test-slave-z8x9"
server_key: "4fd2a8e44a0175ef5c6fdab589f5393d"
server_key_iv: "bc5cbde6220787de6f6b95826827dd12"
server_key_version: "encryptionkey@0"
I20260811 11:10:00.745532 2506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:10:00.762552 2506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:10:00.765246 2506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:10:00.765419 2506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:10:00.770074 2506 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.62:41373
I20260811 11:10:00.770113 2623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.62:41373 every 8 connection(s)
I20260811 11:10:00.770509 2506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/data/info.pb
I20260811 11:10:00.771576 2624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:10:00.773294 2624 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:10:00.775074 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2506
I20260811 11:10:00.775223 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-0/wal/instance
I20260811 11:10:00.775455 26508 external_mini_cluster.cc:1428] Setting key 65f882ce602b5fc57645f09fa3df1317
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.227.61@KRBTEST.COM; defaulting to no policy
I20260811 11:10:00.785455 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.774045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41373 (local address 127.0.0.1:33338)
0811 11:10:00.774411 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.774459 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:00.775078 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:00.775491 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:00.775510 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:00.775802 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:00.775971 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.775975 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.777563 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.777564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:00.778718 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.778722 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.779366 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.779367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:00.779454 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:00.780017 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:00.780028 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:00.781894 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:00.783812 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:00.783820 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:00.783822 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:00.784034 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:00.784301 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:00.784302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:00.784303 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:00.784399 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:00.784772 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:00.784778 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:00.784848 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 11:10:00.784960 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 11:10:00.785237 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":98,"thread_start_us":151,"threads_started":1}
I20260811 11:10:00.785458 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.774145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.25.227.62:41373)
0811 11:10:00.774423 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:00.774433 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:00.774645 (+ 212us) server_negotiation.cc:407] Connection header received
0811 11:10:00.775328 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:00.775332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:00.775359 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:00.775476 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:00.776085 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.777427 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.778815 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.779206 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.779297 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:00.782006 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:00.782013 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:00.782013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:00.782019 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:00.783698 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:00.784129 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:00.784132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:00.784133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:00.784223 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:00.784469 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:00.784470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:00.784470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:00.784695 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:00.784793 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:00.784996 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 11:10:00.785141 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":80,"threads_started":1}
I20260811 11:10:00.786276 2624 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:10:00.786640 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.786525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:51984)
0811 11:10:00.786573 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.786619 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 11:10:00.786784 2541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
I20260811 11:10:00.787431 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.787151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:51988)
0811 11:10:00.787308 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.787398 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.61@KRBTEST.COM" created.
W20260811 11:10:00.787580 2624 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:37331: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab.
Entry for principal kudu/127.25.227.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab.
I20260811 11:10:00.804004 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:37331
--webserver_interface=127.25.227.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab
--principal=kudu/127.25.227.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41373,127.25.227.61:37331,127.25.227.60:40325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:10:00.836844 2624 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } attempt: 1
I20260811 11:10:00.837445 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.837294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52004)
0811 11:10:00.837373 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.837410 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 11:10:00.837814 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.837712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52018)
0811 11:10:00.837760 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.837785 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 11:10:00.837911 2624 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:37331: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
W20260811 11:10:00.888800 2634 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:10:00.889058 2634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:10:00.889091 2634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:10:00.889132 2634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:10:00.890275 2634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:10:00.890343 2634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:10:00.890367 2634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:10:00.890386 2634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:10:00.890415 2634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:10:00.891914 2634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41373,127.25.227.61:37331,127.25.227.60:40325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.61.keytab
--principal=kudu/127.25.227.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.61:37331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.25.227.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:10:00.892206 2634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:10:00.892444 2634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:10:00.897424 2642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:10:00.897420 2644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:10:00.897397 2648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:10:00.897457 2634 server_base.cc:1034] running on GCE node
I20260811 11:10:00.897891 2634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:10:00.898195 2634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:10:00.899341 2634 hybrid_clock.cc:648] HybridClock initialized: now 1786446600899314 us; error 44 us; skew 500 ppm
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:10:00.901993 2634 init.cc:377] Logged in from keytab as kudu/127.25.227.61@KRBTEST.COM (short username kudu)
I20260811 11:10:00.902495 2634 webserver.cc:460] Webserver started at http://127.25.227.61:39303/ using document root <none> and password file <none>
I20260811 11:10:00.902729 2634 fs_manager.cc:359] Metadata directory not provided
I20260811 11:10:00.902809 2634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:10:00.902971 2634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:10:00.904054 2634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data/instance:
uuid: "e0681c88677c45d99e918eef758eeaff"
format_stamp: "Formatted at 2026-08-11 11:10:00 on dist-test-slave-z8x9"
server_key: "f818b42870fcba6198923c05457fa7d2"
server_key_iv: "72d503a6c8ca03875e57c3b3d05c011d"
server_key_version: "encryptionkey@0"
I20260811 11:10:00.904430 2634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal/instance:
uuid: "e0681c88677c45d99e918eef758eeaff"
format_stamp: "Formatted at 2026-08-11 11:10:00 on dist-test-slave-z8x9"
server_key: "f818b42870fcba6198923c05457fa7d2"
server_key_iv: "72d503a6c8ca03875e57c3b3d05c011d"
server_key_version: "encryptionkey@0"
I20260811 11:10:00.905897 2634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 11:10:00.906065 2624 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } attempt: 2
I20260811 11:10:00.906502 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.906339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52034)
0811 11:10:00.906400 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.906460 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 11:10:00.906791 2657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:10:00.906951 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.906817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52050)
0811 11:10:00.906885 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.906921 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 11:10:00.906955 2634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
W20260811 11:10:00.907059 2624 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.61:37331: Network error: Client connection negotiation failed: client connection to 127.25.227.61:37331: connect: Connection refused (error 111)
I20260811 11:10:00.907052 2634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal
uuid: "e0681c88677c45d99e918eef758eeaff"
format_stamp: "Formatted at 2026-08-11 11:10:00 on dist-test-slave-z8x9"
server_key: "f818b42870fcba6198923c05457fa7d2"
server_key_iv: "72d503a6c8ca03875e57c3b3d05c011d"
server_key_version: "encryptionkey@0"
I20260811 11:10:00.907117 2634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:10:00.932643 2634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:10:00.934831 2634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:10:00.934952 2634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:10:00.938930 2634 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.61:37331
I20260811 11:10:00.938985 2754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.61:37331 every 8 connection(s)
I20260811 11:10:00.939397 2634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/data/info.pb
I20260811 11:10:00.940529 2756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:10:00.942204 2756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:10:00.949653 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2634
I20260811 11:10:00.949756 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-1/wal/instance
I20260811 11:10:00.949999 26508 external_mini_cluster.cc:1428] Setting key d2329e025ad6904bb2b8162f6f558df8
I20260811 11:10:00.951759 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.942955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33352 (local address 127.25.227.62:41373)
0811 11:10:00.943022 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:00.943025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:00.943256 (+ 231us) server_negotiation.cc:407] Connection header received
0811 11:10:00.943770 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:00.943771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:00.943786 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:00.943839 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:00.944472 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.944983 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.946059 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.946297 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.946388 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:00.948659 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:00.948661 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:00.948661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:00.948669 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:00.950314 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:00.950729 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:00.950731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:00.950732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:00.950801 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:00.951061 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:00.951062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:00.951062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:00.951190 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:00.951286 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:00.951578 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 11:10:00.951667 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 11:10:00.951982 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.942923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41373 (local address 127.0.0.1:33352)
0811 11:10:00.943122 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.943159 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:00.943649 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:00.943909 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:00.943912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:00.944169 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:00.944372 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.944376 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.945088 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.945089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:00.945960 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.945963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.946412 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.946413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:00.946547 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:00.947028 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:00.947036 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:00.948539 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:00.950404 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:00.950413 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:00.950415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:00.950651 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:00.950870 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:00.950871 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:00.950872 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:00.950992 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:00.951279 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:00.951287 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:00.951434 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 11:10:00.951542 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 11:10:00.951707 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":100,"threads_started":1}
I20260811 11:10:00.952593 2756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.25.227.60@KRBTEST.COM; defaulting to no policy
I20260811 11:10:00.960330 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.952894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52058)
0811 11:10:00.952938 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.952948 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:00.952985 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:00.953320 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:00.953322 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:00.953487 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:00.953564 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.953566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.954428 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.954429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:00.954915 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.954916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.955415 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.955416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:00.955484 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:00.955928 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:00.955934 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:00.957405 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:00.959211 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:00.959212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:00.959212 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:00.959402 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:00.959630 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:00.959631 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:00.959631 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:00.959688 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:00.960003 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:00.960004 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:00.960044 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 11:10:00.960106 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 11:10:00.960209 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 11:10:00.960403 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.952948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52058 (local address 127.25.227.61:37331)
0811 11:10:00.953110 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:00.953114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:00.953132 (+ 18us) server_negotiation.cc:407] Connection header received
0811 11:10:00.953151 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:00.953155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:00.953212 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:00.953287 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:00.953650 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.954325 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.955005 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.955328 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.955408 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:00.957494 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:00.957503 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:00.957504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:00.957511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:00.959105 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:00.959493 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:00.959498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:00.959499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:00.959556 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:00.959772 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:00.959773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:00.959773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:00.959923 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:00.960016 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:00.960134 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:10:00.960272 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":137,"thread_start_us":108,"threads_started":1}
I20260811 11:10:00.961138 2756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:10:00.961530 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.961403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35174)
0811 11:10:00.961452 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.961499 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 11:10:00.961663 2663 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.25.227.60@KRBTEST.COM" created.
I20260811 11:10:00.962141 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.962038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35178)
0811 11:10:00.962071 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.962105 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 11:10:00.962271 2756 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:40325: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.25.227.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab.
Entry for principal kudu/127.25.227.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab.
I20260811 11:10:00.978055 26508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgatKIY/build/release/bin/kudu
/tmp/dist-test-taskgatKIY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:40325
--webserver_interface=127.25.227.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab
--principal=kudu/127.25.227.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.25.227.20:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.25.227.62:41373,127.25.227.61:37331,127.25.227.60:40325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 11:10:00.998201 2624 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } attempt: 3
Aug 11 11:10:00 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
I20260811 11:10:01.006039 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.998626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52062)
0811 11:10:00.998694 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:00.998705 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:00.998750 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:00.998918 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:00.998919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:00.999111 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:00.999190 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:00.999192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.999846 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:00.999847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.000655 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.000658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.001066 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.001068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.001143 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.001638 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:01.001644 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:01.003098 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:01.004777 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.004778 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.004779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.004965 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.005249 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.005250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.005250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.005323 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.005687 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:01.005688 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:01.005739 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 11:10:01.005821 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 11:10:01.005928 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 11:10:01.006039 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:00.998715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52062 (local address 127.25.227.61:37331)
0811 11:10:00.998779 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:00.998782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:00.998792 (+ 10us) server_negotiation.cc:407] Connection header received
0811 11:10:00.998818 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:00.998818 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:00.998828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:00.998890 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:00.999281 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:00.999764 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.000767 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.000985 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.001045 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.003240 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.003242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.003242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.003249 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.004684 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.005053 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.005054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.005055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.005117 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.005472 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.005473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.005474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.005601 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.005689 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.005863 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.005943 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 11:10:01.006482 2624 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:10:01.006871 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.006755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35186)
0811 11:10:01.006809 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.006837 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 11:10:01.007228 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.007166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35202)
0811 11:10:01.007191 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.007213 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 11:10:01.007331 2624 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:40325: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
I20260811 11:10:01.011518 2756 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } attempt: 1
I20260811 11:10:01.011926 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.011802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35204)
0811 11:10:01.011858 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.011895 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 11:10:01.012322 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.012215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35212)
0811 11:10:01.012270 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.012300 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 11:10:01.012435 2756 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:40325: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
I20260811 11:10:01.038498 2624 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } attempt: 1
I20260811 11:10:01.039064 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.038914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35228)
0811 11:10:01.038989 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.039032 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 11:10:01.039464 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.039380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35236)
0811 11:10:01.039421 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.039447 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 11:10:01.039577 2624 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:40325: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
W20260811 11:10:01.064955 2772 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 11:10:01.065251 2772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 11:10:01.065315 2772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 11:10:01.065359 2772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 11:10:01.066504 2772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 11:10:01.066571 2772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 11:10:01.066596 2772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 11:10:01.066628 2772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 11:10:01.066655 2772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 11:10:01.068171 2772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.25.227.20:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.25.227.62:41373,127.25.227.61:37331,127.25.227.60:40325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/krb5kdc/kudu_127.25.227.60.keytab
--principal=kudu/127.25.227.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.25.227.60:40325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.25.227.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 10:16:46 UTC on ccycloud.quasar-tsnumj.root.comops.site
build id 4580137
I20260811 11:10:01.068468 2772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 11:10:01.068706 2772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 11:10:01.074081 2784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:10:01.074051 2782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 11:10:01.074081 2781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 11:10:01.074359 2772 server_base.cc:1034] running on GCE node
I20260811 11:10:01.074641 2772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 11:10:01.075003 2772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 11:10:01.076184 2772 hybrid_clock.cc:648] HybridClock initialized: now 1786446601076169 us; error 28 us; skew 500 ppm
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446601, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 11:10:01.078915 2772 init.cc:377] Logged in from keytab as kudu/127.25.227.60@KRBTEST.COM (short username kudu)
I20260811 11:10:01.079399 2772 webserver.cc:460] Webserver started at http://127.25.227.60:45409/ using document root <none> and password file <none>
I20260811 11:10:01.079674 2772 fs_manager.cc:359] Metadata directory not provided
I20260811 11:10:01.079754 2772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 11:10:01.079921 2772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 11:10:01.080621 2756 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } attempt: 2
I20260811 11:10:01.081036 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.080905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35248)
0811 11:10:01.080969 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.081005 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 11:10:01.081491 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.081400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35264)
0811 11:10:01.081447 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.081473 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 11:10:01.081610 2756 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.227.60:40325: Network error: Client connection negotiation failed: client connection to 127.25.227.60:40325: connect: Connection refused (error 111)
I20260811 11:10:01.081387 2772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data/instance:
uuid: "558cbfaefe6c4e47ab84bebb36287e7a"
format_stamp: "Formatted at 2026-08-11 11:10:01 on dist-test-slave-z8x9"
server_key: "831ea65ce79c93e40b91f4d0d7f55e0f"
server_key_iv: "9252649a847b3367618b23e9b4143c0d"
server_key_version: "encryptionkey@0"
I20260811 11:10:01.081947 2772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal/instance:
uuid: "558cbfaefe6c4e47ab84bebb36287e7a"
format_stamp: "Formatted at 2026-08-11 11:10:01 on dist-test-slave-z8x9"
server_key: "831ea65ce79c93e40b91f4d0d7f55e0f"
server_key_iv: "9252649a847b3367618b23e9b4143c0d"
server_key_version: "encryptionkey@0"
I20260811 11:10:01.083431 2772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 11:10:01.084254 2800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 11:10:01.084436 2772 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 11:10:01.084547 2772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data,/tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal
uuid: "558cbfaefe6c4e47ab84bebb36287e7a"
format_stamp: "Formatted at 2026-08-11 11:10:01 on dist-test-slave-z8x9"
server_key: "831ea65ce79c93e40b91f4d0d7f55e0f"
server_key_iv: "9252649a847b3367618b23e9b4143c0d"
server_key_version: "encryptionkey@0"
I20260811 11:10:01.084642 2772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 11:10:01.094406 2772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 11:10:01.096457 2772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 11:10:01.096649 2772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 11:10:01.101317 2772 rpc_server.cc:307] RPC server started. Bound to: 127.25.227.60:40325
I20260811 11:10:01.101388 2893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.227.60:40325 every 8 connection(s)
I20260811 11:10:01.101809 2772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/data/info.pb
I20260811 11:10:01.102864 2895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 11:10:01.103973 26508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgatKIY/build/release/bin/kudu as pid 2772
I20260811 11:10:01.104113 26508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgatKIY/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786446315517896-26508-0/minicluster-data/master-2/wal/instance
I20260811 11:10:01.104374 26508 external_mini_cluster.cc:1428] Setting key a9348c76cdb6b9ce21bbdefafddf7425
I20260811 11:10:01.104993 2895 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446601, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:10:01.114511 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.105808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33366 (local address 127.25.227.62:41373)
0811 11:10:01.105855 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.105857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.106020 (+ 163us) server_negotiation.cc:407] Connection header received
0811 11:10:01.106095 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.106096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.106107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.106207 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.106826 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.107327 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.108234 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.108431 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.108521 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.111039 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.111041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.111041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.111047 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.112943 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.113479 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.113480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.113481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.113550 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.113812 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.113813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.113813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.113942 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.114030 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.114331 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.114418 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 11:10:01.114701 2907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.105758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.62:41373 (local address 127.0.0.1:33366)
0811 11:10:01.105906 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.105954 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:01.106039 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:01.106247 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:01.106250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:01.106556 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:01.106723 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.106727 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.107416 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.107418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.108131 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.108134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.108554 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.108556 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.108682 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.109248 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:01.109259 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:01.110938 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:01.113031 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.113038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.113039 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.113403 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.113616 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.113617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.113617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.113733 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.114022 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:01.114030 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:01.114173 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 11:10:01.114295 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 11:10:01.114449 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260811 11:10:01.114784 2905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.104941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35280 (local address 127.25.227.60:40325)
0811 11:10:01.105131 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.105139 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.105165 (+ 26us) server_negotiation.cc:407] Connection header received
0811 11:10:01.105847 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.105857 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.105919 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.106069 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.106746 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.107574 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.108383 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.108693 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.108789 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.111631 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.111640 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.111641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.111649 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.113492 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.113860 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.113863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.113864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.113932 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.114146 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.114147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.114148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.114307 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.114468 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.114543 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.114625 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
I20260811 11:10:01.114796 2624 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } attempt: 2
I20260811 11:10:01.115792 2895 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446601, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.62@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.62@KRBTEST.COM
I20260811 11:10:01.124554 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.115390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35290)
0811 11:10:01.115423 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.115433 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:01.115474 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:01.115749 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:01.115750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:01.115924 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:01.115964 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.115966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.116947 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.116948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.118246 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.118249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.118741 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.118828 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.119217 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:01.119223 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:01.120831 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:01.123252 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.123253 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.123254 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.123504 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.123774 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.123776 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.123776 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.123850 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.124151 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:01.124152 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:01.124206 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 11:10:01.124301 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 11:10:01.124416 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 11:10:01.124590 2905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.115592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35290 (local address 127.25.227.60:40325)
0811 11:10:01.115631 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.115633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.115640 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:10:01.115658 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.115658 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.115667 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.116305 (+ 638us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.116333 (+ 28us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.116829 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118339 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.118647 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118724 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.120944 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.120946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.120946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.120954 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.123158 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.123587 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.123588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.123589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.123668 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.123939 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.123940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.123941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.124068 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.124157 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.124332 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.124467 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:10:01.125453 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.115771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33380 (local address 127.25.227.62:41373)
0811 11:10:01.116156 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.116158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.116165 (+ 7us) server_negotiation.cc:407] Connection header received
0811 11:10:01.116184 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.116185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.116193 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.116258 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.116865 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.117626 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118604 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.119152 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.119206 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.122099 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.122100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.122101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.122109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.123866 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.124255 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.124256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.124257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.124319 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.124609 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.124610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.124610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.124769 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.124892 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.125198 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.125300 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368}
I20260811 11:10:01.125829 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.116109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52074 (local address 127.25.227.61:37331)
0811 11:10:01.116154 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.116157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.116165 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:10:01.116191 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.116192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.116202 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.116258 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.116736 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.117366 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118006 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.118235 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118458 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.121380 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.121382 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.121382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.121391 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.124126 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.124585 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.124587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.124587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.124652 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.125067 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.125069 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.125069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.125258 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.125310 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.125653 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.125737 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 11:10:01.126130 2907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.116033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.61:37331 (local address 127.0.0.1:52074)
0811 11:10:01.116080 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.116090 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:01.116125 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:01.116419 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:01.116420 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:01.116573 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:01.116641 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.116643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.117444 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.117445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.117921 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.117922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.118346 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.118347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.118456 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.118907 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:01.118913 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:01.121261 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:01.124238 (+ 2977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.124239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.124240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.124498 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.124737 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.124738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.124738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.124971 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.125446 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:01.125447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:01.125484 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 11:10:01.125917 (+ 433us) client_negotiation.cc:240] Negotiation successful
0811 11:10:01.126025 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 11:10:01.126528 2895 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } has no permanent_uuid. Determining permanent_uuid...
I20260811 11:10:01.126910 2624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9: Bootstrap starting.
I20260811 11:10:01.127823 2624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9: Neither blocks nor log segments found. Creating new log.
I20260811 11:10:01.128146 2624 log.cc:824] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9: Log is configured to *not* fsync() on all Append() calls
I20260811 11:10:01.129911 2624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9: No bootstrap required, opened a new log
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.25.227.61@KRBTEST.COM
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446601, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.60@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:10:01.132021 2624 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.132196 2624 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9e890e4a674d64b88fe55f88755ca9, State: Initialized, Role: FOLLOWER
I20260811 11:10:01.132320 2624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.132809 2624 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:10:01.133134 2909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
W20260811 11:10:01.135152 2927 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:10:01.135267 2927 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:10:01.135432 2905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.126885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35292 (local address 127.25.227.60:40325)
0811 11:10:01.126919 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.126921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.126929 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:10:01.127042 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.127043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.127055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.127116 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.127458 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.128185 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.129012 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.129322 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.129413 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.131955 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.131957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.131957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.131965 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.133989 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.134447 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.134449 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.134450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.134523 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.134769 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.134770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.134771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.134968 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.135018 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.135238 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.135335 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 11:10:01.135717 2907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.126808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35292)
0811 11:10:01.126874 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.126886 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:01.126933 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:01.127147 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:01.127148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:01.127311 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:01.127356 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.127359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.128283 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.128284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.128894 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.128897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.129414 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.129415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.129474 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.129939 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:01.129945 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:01.131834 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:01.134100 (+ 2266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.134102 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.134103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.134373 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.134612 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.134613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.134613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.134684 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.135067 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:01.135068 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:01.135110 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 11:10:01.135521 (+ 411us) client_negotiation.cc:240] Negotiation successful
0811 11:10:01.135629 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 11:10:01.135957 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.126066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52086 (local address 127.25.227.61:37331)
0811 11:10:01.126459 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.126461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.126469 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:10:01.126487 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.126488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.126496 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.126577 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.127178 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.127681 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.128477 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.128710 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.128790 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.131990 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.131991 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.131992 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.132001 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.134133 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.134586 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.134587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.134588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.134652 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.134882 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.134883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.134883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.135026 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.135193 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.135724 (+ 531us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.135823 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375}
I20260811 11:10:01.133335 2909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.137635 2895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: Bootstrap starting.
I20260811 11:10:01.138790 2895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: Neither blocks nor log segments found. Creating new log.
I20260811 11:10:01.136014 2506 master_runner.cc:186] Error getting master registration for 127.25.227.61:37331: OK, instance_id { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" instance_seqno: 1786446600937802 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:10:01.138882 2506 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:10:01.139150 2895 log.cc:824] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: Log is configured to *not* fsync() on all Append() calls
I20260811 11:10:01.139446 26508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 11:10:01.140313 2581 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9a9e890e4a674d64b88fe55f88755ca9"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33380
I20260811 11:10:01.140465 2581 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 11:10:01.140519 2581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:10:01.140693 2895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: No bootstrap required, opened a new log
I20260811 11:10:01.141548 2581 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.141834 2581 leader_election.cc:288] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [CANDIDATE]: Term 1 election: Requested vote from peers e0681c88677c45d99e918eef758eeaff (127.25.227.61:37331), 558cbfaefe6c4e47ab84bebb36287e7a (127.25.227.60:40325)
I20260811 11:10:01.142786 2895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.142966 2895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558cbfaefe6c4e47ab84bebb36287e7a, State: Initialized, Role: FOLLOWER
I20260811 11:10:01.143054 2895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.143395 2895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:10:01.143440 2855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9a9e890e4a674d64b88fe55f88755ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "558cbfaefe6c4e47ab84bebb36287e7a"
I20260811 11:10:01.143537 2855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:10:01.144501 2855 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9e890e4a674d64b88fe55f88755ca9 in term 1.
I20260811 11:10:01.144760 2537 leader_election.cc:302] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558cbfaefe6c4e47ab84bebb36287e7a, 9a9e890e4a674d64b88fe55f88755ca9; no voters:
I20260811 11:10:01.144934 2909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 11:10:01.145098 2909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [term 1 LEADER]: Becoming Leader. State: Replica: 9a9e890e4a674d64b88fe55f88755ca9, State: Running, Role: LEADER
I20260811 11:10:01.145220 2909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.145756 2909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a9e890e4a674d64b88fe55f88755ca9. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.145864 2909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:10:01.146457 2975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 11:10:01.146680 2975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 11:10:01.148430 2855 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [term 1 FOLLOWER]: Refusing update from remote peer 9a9e890e4a674d64b88fe55f88755ca9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:10:01.148830 2909 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:10:01.148270 2772 master_runner.cc:186] Error getting master registration for 127.25.227.61:37331: OK, instance_id { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" instance_seqno: 1786446600937802 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 11:10:01.151512 2772 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 11:10:01.153650 2977 mvcc.cc:205] Tried to move back new op lower bound from 7317285278300778496 to 7317285278291906560. Current Snapshot: MvccSnapshot[applied={T|T < 7317285278300778496}]
I20260811 11:10:01.153920 2909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.154003 2909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: This master's current role is: LEADER
I20260811 11:10:01.155175 2980 mvcc.cc:205] Tried to move back new op lower bound from 7317285278300778496 to 7317285278291906560. Current Snapshot: MvccSnapshot[applied={T|T < 7317285278300778496}]
I20260811 11:10:01.155416 2975 catalog_manager.cc:1347] Generated new cluster ID: 7a3c0feeed774d3dbf995e33859fc16b
I20260811 11:10:01.155455 2975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 11:10:01.161144 2979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.161398 2979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.161477 2979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a9e890e4a674d64b88fe55f88755ca9. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.161535 2979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.161573 2979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.161613 2979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.162777 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.143290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.25.227.62:41373)
0811 11:10:01.143338 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.143340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.144563 (+ 1223us) server_negotiation.cc:407] Connection header received
0811 11:10:01.144757 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.144758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.144771 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.144806 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.146392 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.147210 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.149680 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.150006 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.150054 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.153303 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.153304 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.153305 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.153329 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.155446 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.161920 (+ 6474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.161921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.161922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.162012 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.162216 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.162217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.162217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.162346 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.162450 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.162568 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.162652 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:10:01.166326 2761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.144088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52088 (local address 127.25.227.61:37331)
0811 11:10:01.144136 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.144138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.153326 (+ 9188us) server_negotiation.cc:407] Connection header received
0811 11:10:01.153439 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.153441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.153453 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.153488 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.154247 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.155050 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.156176 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.156550 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.156599 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.159094 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.159096 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.159096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.159105 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.160947 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.165356 (+ 4409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.165358 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.165358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.165430 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.165651 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.165652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.165653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.165797 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.165900 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.166111 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.166206 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:10:01.166801 2905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.143762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35298 (local address 127.25.227.60:40325)
0811 11:10:01.143810 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.143812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.150798 (+ 6986us) server_negotiation.cc:407] Connection header received
0811 11:10:01.150988 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.150989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.151003 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.151043 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.151987 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.152794 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.157882 (+ 5088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.158178 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.158242 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.162664 (+ 4422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.162666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.162667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.162675 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.164874 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.165566 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.165567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.165568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.165637 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.165945 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.165945 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.165946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.166080 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.166153 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.166622 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.166714 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 11:10:01.168718 2968 catalog_manager.cc:1259] Loaded cluster ID: 7a3c0feeed774d3dbf995e33859fc16b
I20260811 11:10:01.168774 2968 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: loading cluster ID for follower catalog manager: success
W20260811 11:10:01.168906 2968 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260811 11:10:01.168949 2968 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:10:01.172751 2756 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } attempt: 3
Aug 11 11:10:01 dist-test-slave-z8x9 krb5kdc[2482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786446600, etypes {rep=17 tkt=17 ses=17}, kudu/127.25.227.61@KRBTEST.COM for kudu/127.25.227.60@KRBTEST.COM
I20260811 11:10:01.184769 2759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.173102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.227.60:40325 (local address 127.0.0.1:35314)
0811 11:10:01.173262 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 11:10:01.173275 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 11:10:01.173322 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 11:10:01.173586 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 11:10:01.173587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 11:10:01.173799 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 11:10:01.173851 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.173853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.175801 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.175802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.176743 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 11:10:01.176745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.177466 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.177468 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 11:10:01.177548 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.178210 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 11:10:01.178216 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 11:10:01.179987 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 11:10:01.182461 (+ 2474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.182463 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.182463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.182734 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.183013 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 11:10:01.183014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 11:10:01.183015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 11:10:01.183096 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 11:10:01.183457 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 11:10:01.183458 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 11:10:01.184464 (+ 1006us) client_negotiation.cc:769] Sending connection context
0811 11:10:01.184538 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 11:10:01.184652 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260811 11:10:01.185245 2905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:01.173404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35314 (local address 127.25.227.60:40325)
0811 11:10:01.173445 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.173447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.173455 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:10:01.173477 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.173478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.173489 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.173539 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.173946 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.174814 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.176869 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:01.177313 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:01.177385 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:01.180145 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 11:10:01.180147 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 11:10:01.180147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 11:10:01.180156 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 11:10:01.182322 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.182839 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.182840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.182841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.182921 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 11:10:01.183181 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 11:10:01.183182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 11:10:01.183182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 11:10:01.183355 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 11:10:01.183419 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:01.184993 (+ 1574us) server_negotiation.cc:299] Negotiation successful
0811 11:10:01.185083 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 11:10:01.186913 2756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: Bootstrap starting.
I20260811 11:10:01.187772 2756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: Neither blocks nor log segments found. Creating new log.
I20260811 11:10:01.188113 2756 log.cc:824] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: Log is configured to *not* fsync() on all Append() calls
I20260811 11:10:01.189343 2756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: No bootstrap required, opened a new log
I20260811 11:10:01.191015 2975 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 11:10:01.191562 2756 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.191725 2756 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0681c88677c45d99e918eef758eeaff, State: Initialized, Role: FOLLOWER
I20260811 11:10:01.191751 2975 catalog_manager.cc:1504] Loading token signing keys...
I20260811 11:10:01.191817 2756 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } }
I20260811 11:10:01.192183 2756 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 11:10:01.192334 2702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [term 0 FOLLOWER]: Advancing to term 1
I20260811 11:10:01.193245 2702 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [term 1 FOLLOWER]: Refusing update from remote peer 9a9e890e4a674d64b88fe55f88755ca9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 11:10:01.193539 2971 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 11:10:01.193940 2703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9a9e890e4a674d64b88fe55f88755ca9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e0681c88677c45d99e918eef758eeaff"
W20260811 11:10:01.198895 3015 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 11:10:01.198968 3015 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 11:10:01.199287 2995 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.199373 2995 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.199429 2995 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a9e890e4a674d64b88fe55f88755ca9. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.199484 2995 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.199519 2995 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.199610 2995 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [sys.catalog]: This master's current role is: FOLLOWER
I20260811 11:10:01.201555 2975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9: Generated new TSK 0
I20260811 11:10:01.201752 2975 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 11:10:01.206293 3005 mvcc.cc:205] Tried to move back new op lower bound from 7317285278471938048 to 7317285278291906560. Current Snapshot: MvccSnapshot[applied={T|T < 7317285278300778496}]
I20260811 11:10:01.206486 2703 raft_consensus.cc:2396] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a9e890e4a674d64b88fe55f88755ca9 for term 1 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 11:10:01.207141 2986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9a9e890e4a674d64b88fe55f88755ca9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9e890e4a674d64b88fe55f88755ca9" member_type: VOTER last_known_addr { host: "127.25.227.62" port: 41373 } } peers { permanent_uuid: "e0681c88677c45d99e918eef758eeaff" member_type: VOTER last_known_addr { host: "127.25.227.61" port: 37331 } } peers { permanent_uuid: "558cbfaefe6c4e47ab84bebb36287e7a" member_type: VOTER last_known_addr { host: "127.25.227.60" port: 40325 } } }
I20260811 11:10:01.207255 2986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9e890e4a674d64b88fe55f88755ca9 [sys.catalog]: This master's current role is: LEADER
W20260811 11:10:01.234922 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.232845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.25.227.61:37331)
0811 11:10:01.232896 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.232898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.233973 (+ 1075us) server_negotiation.cc:407] Connection header received
0811 11:10:01.234094 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.234095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.234109 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.234144 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.234829 (+ 685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52090: BlockingRecv error: recv got EOF from 127.0.0.1:52090 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 11:10:01.235757 2628 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.233339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33394 (local address 127.25.227.62:41373)
0811 11:10:01.233388 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.233390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.234624 (+ 1234us) server_negotiation.cc:407] Connection header received
0811 11:10:01.235168 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.235170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.235182 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.235216 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.235679 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33394: BlockingRecv error: recv got EOF from 127.0.0.1:33394 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 11:10:01.236531 2905 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.233756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35316 (local address 127.25.227.60:40325)
0811 11:10:01.233825 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.233828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.235959 (+ 2131us) server_negotiation.cc:407] Connection header received
0811 11:10:01.236067 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.236069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.236081 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.236113 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.236462 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35316: BlockingRecv error: recv got EOF from 127.0.0.1:35316 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 11:10:01.239216 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.238351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52092 (local address 127.25.227.61:37331)
0811 11:10:01.238392 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.238394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.238644 (+ 250us) server_negotiation.cc:407] Connection header received
0811 11:10:01.238768 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.238769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.238790 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.238823 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.239162 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52092: BlockingRecv error: recv got EOF from 127.0.0.1:52092 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 11:10:01.242501 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.241592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.25.227.61:37331)
0811 11:10:01.241630 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.241632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.241928 (+ 296us) server_negotiation.cc:407] Connection header received
0811 11:10:01.242053 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.242054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.242065 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.242097 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.242449 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52104: BlockingRecv error: recv got EOF from 127.0.0.1:52104 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 11:10:01.246506 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.245688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52116 (local address 127.25.227.61:37331)
0811 11:10:01.245725 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.245726 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.245980 (+ 254us) server_negotiation.cc:407] Connection header received
0811 11:10:01.246079 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.246080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.246092 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.246123 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.246459 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52116: BlockingRecv error: recv got EOF from 127.0.0.1:52116 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 11:10:01.252638 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.251780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52124 (local address 127.25.227.61:37331)
0811 11:10:01.251818 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.251820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.252075 (+ 255us) server_negotiation.cc:407] Connection header received
0811 11:10:01.252178 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.252179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.252189 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.252221 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.252578 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52124: BlockingRecv error: recv got EOF from 127.0.0.1:52124 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 11:10:01.262975 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.261974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52132 (local address 127.25.227.61:37331)
0811 11:10:01.262016 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.262019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.262340 (+ 321us) server_negotiation.cc:407] Connection header received
0811 11:10:01.262458 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.262460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.262472 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.262506 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.262910 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52132: BlockingRecv error: recv got EOF from 127.0.0.1:52132 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 11:10:01.281617 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.280447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52140 (local address 127.25.227.61:37331)
0811 11:10:01.280496 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.280499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.280853 (+ 354us) server_negotiation.cc:407] Connection header received
0811 11:10:01.280976 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.280977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.280991 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.281026 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.281550 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52140: BlockingRecv error: recv got EOF from 127.0.0.1:52140 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 11:10:01.316262 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.315129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52150 (local address 127.25.227.61:37331)
0811 11:10:01.315182 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.315185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.315544 (+ 359us) server_negotiation.cc:407] Connection header received
0811 11:10:01.315673 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.315674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.315688 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.315724 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.316178 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52150: BlockingRecv error: recv got EOF from 127.0.0.1:52150 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 11:10:01.382776 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.381926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52164 (local address 127.25.227.61:37331)
0811 11:10:01.382006 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.382008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.382190 (+ 182us) server_negotiation.cc:407] Connection header received
0811 11:10:01.382230 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.382232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.382261 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.382335 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.382711 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52164: BlockingRecv error: recv got EOF from 127.0.0.1:52164 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 11:10:01.512775 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.511957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.25.227.61:37331)
0811 11:10:01.512037 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.512039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.512150 (+ 111us) server_negotiation.cc:407] Connection header received
0811 11:10:01.512219 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.512220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.512232 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.512298 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.512696 (+ 398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52166: BlockingRecv error: recv got EOF from 127.0.0.1:52166 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 11:10:01.770864 2761 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 11:10:01.770140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.25.227.61:37331)
0811 11:10:01.770219 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:01.770221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:01.770305 (+ 84us) server_negotiation.cc:407] Connection header received
0811 11:10:01.770345 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:01.770346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:01.770360 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:01.770440 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 11:10:01.770803 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52182: BlockingRecv error: recv got EOF from 127.0.0.1:52182 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 11:10:02.170167 2968 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: acquiring CA information for follower catalog manager: success
I20260811 11:10:02.170588 2968 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 558cbfaefe6c4e47ab84bebb36287e7a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:10:02.199446 3015 catalog_manager.cc:1259] Loaded cluster ID: 7a3c0feeed774d3dbf995e33859fc16b
I20260811 11:10:02.199558 3015 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: loading cluster ID for follower catalog manager: success
I20260811 11:10:02.200383 3015 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: acquiring CA information for follower catalog manager: success
I20260811 11:10:02.200703 3015 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e0681c88677c45d99e918eef758eeaff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 11:10:02.286993 3146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:02.284083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.25.227.61:37331)
0811 11:10:02.284248 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:02.284250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:02.284363 (+ 113us) server_negotiation.cc:407] Connection header received
0811 11:10:02.284427 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:02.284428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:02.284482 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:02.284549 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:10:02.284700 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.285266 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.286068 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.286315 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.286380 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:02.286533 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:10:02.286655 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:10:02.286717 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:02.286821 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 11:10:02.286896 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":62,"threads_started":1}
I20260811 11:10:02.291321 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:02.289024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35326 (local address 127.25.227.60:40325)
0811 11:10:02.289151 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:02.289153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:02.289161 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:10:02.289249 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:02.289250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:02.289295 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:02.289368 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:10:02.289459 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.289930 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.290608 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.290818 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.290868 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:02.290997 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:10:02.291100 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:10:02.291154 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:02.291187 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 11:10:02.291205 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":78,"threads_started":1}
I20260811 11:10:02.296054 3146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:02.293134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52198 (local address 127.25.227.61:37331)
0811 11:10:02.293194 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:02.293196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:02.293492 (+ 296us) server_negotiation.cc:407] Connection header received
0811 11:10:02.293558 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:02.293559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:02.293569 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:02.293621 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:10:02.293722 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.294323 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.295223 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.295522 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.295561 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:02.295744 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:10:02.295782 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:10:02.295852 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:02.295949 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 11:10:02.295974 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 11:10:02.296384 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:02.293412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35336 (local address 127.25.227.60:40325)
0811 11:10:02.293445 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:02.293447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:02.293487 (+ 40us) server_negotiation.cc:407] Connection header received
0811 11:10:02.293555 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:02.293556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:02.293565 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:02.293622 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:10:02.293921 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.294634 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.295535 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.295791 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.295855 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:02.296018 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:10:02.296051 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:10:02.296086 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:02.296288 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 11:10:02.296312 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 11:10:02.297088 3164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 11:10:02.293148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33408 (local address 127.25.227.62:41373)
0811 11:10:02.293606 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 11:10:02.293609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 11:10:02.293617 (+ 8us) server_negotiation.cc:407] Connection header received
0811 11:10:02.293661 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 11:10:02.293661 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 11:10:02.293717 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 11:10:02.293832 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 11:10:02.294008 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.294757 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.295890 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 11:10:02.296206 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 11:10:02.296283 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 11:10:02.296733 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 11:10:02.296847 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 11:10:02.296935 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 11:10:02.296995 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 11:10:02.297019 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":108,"threads_started":1}
I20260811 11:10:02.298774 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2506
I20260811 11:10:02.317787 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2634
I20260811 11:10:02.330960 26508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgatKIY/build/release/bin/kudu with pid 2772
2026-08-11T11:10:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3125 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6278 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (286814 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST